-- Logs begin at Fri 2022-07-29 13:36:07 UTC, end at Fri 2022-07-29 15:01:52 UTC. -- Jul 29 14:26:31.581987 dv-cinder-799871-49-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 14:26:31.590503 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 14:26:31 2022] *** Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: nodename: dv-cinder-799871-49-iscsi Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: machine: x86_64 Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: clock source: unix Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: pcre jit disabled Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: detected number of CPU cores: 4 Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: current working directory: / Jul 29 14:26:31.592457 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: detected binary path: /usr/bin/uwsgi-core Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: your processes number limit is 47680 Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: your memory page size is 4096 bytes Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: detected max file descriptor number: 2048 Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: lock engine: pthread robust mutexes Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: thunder lock: enabled Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 14:26:31.593976 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 14:26:31.632526 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: Python main interpreter initialized at 0x5631b8e939c0 Jul 29 14:26:31.632526 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: python threads support enabled Jul 29 14:26:31.632526 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: your server socket listen backlog is limited to 100 connections Jul 29 14:26:31.632526 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: your mercy for graceful operations on workers is 90 seconds Jul 29 14:26:31.632861 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 14:26:31.632944 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: *** Operational MODE: preforking *** Jul 29 14:26:31.633212 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: *** uWSGI is running in multiple interpreter mode *** Jul 29 14:26:31.633212 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: spawned uWSGI master process (pid: 103799) Jul 29 14:26:31.633401 dv-cinder-799871-49-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 14:26:31.636961 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: spawned uWSGI worker 1 (pid: 103800, cores: 1) Jul 29 14:26:31.636961 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: spawned uWSGI worker 2 (pid: 103801, cores: 1) Jul 29 14:26:31.636961 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 14:26:32.300414 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 14:26:32.304840 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 14:26:33.380682 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:26:33.380682 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: from cryptography.utils import int_from_bytes Jul 29 14:26:33.381315 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:26:33.381315 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: from cryptography.utils import int_from_bytes Jul 29 14:26:33.391891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:26:33.391891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: from cryptography.utils import int_from_bytes Jul 29 14:26:33.392350 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:26:33.392350 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: from cryptography.utils import int_from_bytes Jul 29 14:26:35.856834 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 14:26:35.857432 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 14:26:35.857624 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 14:26:35.857979 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 14:26:35.858235 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 14:26:35.858644 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.859150 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.859469 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.859786 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.860113 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.860205 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 14:26:35.860552 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 14:26:35.860630 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.860714 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.860875 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 14:26:35.861049 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.861256 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 14:26:35.861374 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.861508 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 14:26:35.861631 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.861885 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.861970 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862203 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862286 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-49-iscsi {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862518 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862627 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862829 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.862928 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863132 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863215 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863438 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863531 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863733 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.863823 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864051 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864135 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864349 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864446 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864608 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864834 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.864936 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.865989 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-49-iscsi {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866248 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866334 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866459 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866551 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866698 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866789 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866873 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.866950 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867026 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867109 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867194 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867332 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867421 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867507 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867662 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867797 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.867964 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868094 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868324 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868408 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-49-iscsi {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868626 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868712 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.868949 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869058 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869289 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869419 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869589 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869695 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869900 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.869990 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870198 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870290 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870509 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870599 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870808 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.870893 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871194 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871288 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-49-iscsi {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871500 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871596 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871804 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.871933 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872109 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872193 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872421 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872519 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872721 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.872860 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873048 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873152 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873354 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873452 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873672 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.873757 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.874516 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.874611 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.874817 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875065 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875149 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875368 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875454 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875688 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.875781 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876005 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876090 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876302 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876385 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876557 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876657 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876803 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.876895 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877141 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877239 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877460 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877553 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877764 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.877848 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878013 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878099 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878314 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878399 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878626 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878711 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.878934 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879018 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879236 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879321 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879477 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879559 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879720 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.879887 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880031 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880123 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880344 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880429 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880642 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880739 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.880940 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881045 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881264 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881349 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881561 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881713 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881857 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.881963 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882154 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882250 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882449 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882586 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882745 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.882902 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883052 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883203 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883357 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883516 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883668 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883830 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.883966 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884132 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884433 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884669 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884805 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.884914 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885062 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885238 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885395 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885570 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885696 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885879 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.885984 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886176 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886269 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886487 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886570 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886796 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.886889 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887095 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887187 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887390 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887472 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887687 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887787 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.887981 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888071 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888281 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888365 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888581 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888674 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888823 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.888906 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.889139 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.889229 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.889435 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.890154 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.890346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.890499 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.890649 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.890950 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.891043 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.891250 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.891569 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.891663 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.891883 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.892086 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.892249 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.892551 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.892634 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.892852 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.893174 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.893261 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.893490 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.893735 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.893819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.894123 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.894306 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.894438 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.894739 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.894871 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.895040 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.895397 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.895481 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.895702 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.895989 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.896134 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.896308 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.896556 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.896658 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.896890 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.897134 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.897232 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.897518 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.897676 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.897817 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.898116 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.898245 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.898417 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.898718 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.898801 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.899019 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.899318 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.899410 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.899619 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.899914 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.900147 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.900234 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.900530 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.900783 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.900876 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.901142 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.901384 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.901469 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.901728 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.901814 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.902048 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.902132 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.902365 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.902451 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.902694 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.902779 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.903005 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.903095 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.903315 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.903409 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.903636 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.903721 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.903945 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.904029 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.904253 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.904345 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.904567 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.904652 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.904862 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.904945 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.905303 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.905425 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.905619 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.905872 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.905969 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.906181 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.906277 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.906491 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.906576 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.906797 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.906883 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.907107 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.907233 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.907412 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.907521 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.907715 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.907813 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.908015 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.908122 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.908316 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.908425 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.908614 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.908726 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.908930 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.909070 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.909284 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.909381 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.909589 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.909685 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.909891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.910072 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.910193 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.910295 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.910508 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:26:35.910592 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.910841 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.910952 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911149 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911235 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911462 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911556 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911770 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.911869 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912089 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912174 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912421 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912514 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912732 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.912818 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913183 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913276 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913496 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913580 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913807 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.913894 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914116 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914200 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914426 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914511 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914733 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.914819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915049 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915134 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915362 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915447 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915674 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915816 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.915983 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916078 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916294 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916387 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916601 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916686 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.916907 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917003 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917239 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917340 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917576 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917715 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917841 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.917928 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918141 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918240 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918448 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918532 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918747 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.918832 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919064 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919162 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919385 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919471 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919687 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.919772 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920010 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920096 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920310 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920393 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920613 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.920705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.921045 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.921279 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.921405 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.921717 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.921802 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922035 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922130 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922354 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922439 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922665 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922750 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.922976 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923069 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923414 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923585 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923672 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923893 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.923979 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924196 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924280 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924502 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924587 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924817 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.924911 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925146 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925232 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925542 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925764 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.925902 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926069 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926155 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926456 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926673 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926759 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.926972 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927057 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927269 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927363 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927573 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927659 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927871 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.927963 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.928186 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.928280 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.928507 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.928598 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.928806 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929182 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929382 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929489 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929691 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929776 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.929994 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930086 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930295 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930389 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930595 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930689 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930894 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.930978 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931192 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931285 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931498 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931581 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931793 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.931875 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932092 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932177 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932390 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932481 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932689 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.932777 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933013 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933103 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933314 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933399 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933611 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933718 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933909 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.933996 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934209 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934294 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934521 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934615 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934830 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.934920 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935133 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935226 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935450 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935544 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935757 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.935842 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.936063 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.936151 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.936889 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937013 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937234 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937535 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937632 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937842 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.937927 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938151 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938237 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938467 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938552 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938776 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.938860 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939074 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939166 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939382 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939474 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939686 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939780 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.939986 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940072 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940288 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940380 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940589 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940682 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940884 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.940968 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941209 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941296 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941509 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941611 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941807 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.941892 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942104 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942195 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942422 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942525 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942726 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.942810 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943022 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943108 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943593 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943692 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.943946 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.944148 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.944257 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.944563 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.944728 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.944876 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.945208 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.945449 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.945534 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.945820 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.946134 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.946220 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.946432 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.946741 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.946824 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.947064 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.947323 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.947408 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.947685 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.947931 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.948033 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.948297 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.948523 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.948656 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.948898 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.949149 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.949252 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.949520 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.949741 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.949826 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.950118 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.950334 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.950428 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.950725 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.950918 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.951031 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.951332 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.951504 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.951641 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.951951 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.952659 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.952839 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.953166 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.953266 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.953484 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.953810 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.954010 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.954137 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.954398 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.954493 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.954762 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.955001 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.955088 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.955398 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.955590 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.955721 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956029 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956188 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956331 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956632 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956763 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.956978 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.957344 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.957431 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.957652 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.957953 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.958045 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.958269 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.958586 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.958722 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.958893 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.959172 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.959267 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.959495 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.959764 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.959849 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.960103 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.960337 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.960435 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.960703 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961021 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961147 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961334 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961647 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961745 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.961955 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.962273 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.962357 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.962580 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.962865 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963004 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963179 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963322 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963478 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963663 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963785 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.963991 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.964130 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.964324 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.964646 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.964731 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.964977 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965106 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965315 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965406 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965632 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965717 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.965936 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966021 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966249 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966333 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966576 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966660 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966898 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.966985 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.967206 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.967290 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.967518 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.967618 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.967934 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968074 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968237 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968539 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968625 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968847 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.968945 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969173 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969260 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969476 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969570 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969777 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.969871 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970084 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970170 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970383 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970468 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970684 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970777 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.970984 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971069 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971284 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971375 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971595 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971692 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971896 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.971992 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972221 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972316 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972492 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972587 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972800 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.972884 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973125 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973215 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973428 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973515 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973727 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.973812 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974026 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974111 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974340 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974436 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974642 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974734 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.974961 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975046 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975276 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975370 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975578 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975677 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975880 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.975996 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976177 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976268 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976494 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976578 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976798 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.976891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977124 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977212 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977426 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977511 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977733 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.977835 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978037 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978121 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978334 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978426 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978639 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978736 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.978943 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979035 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979250 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979341 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979554 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979646 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979851 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.979936 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980156 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980240 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980454 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980540 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980756 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.980840 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981084 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981183 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981383 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981468 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981687 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981779 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.981990 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982073 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982293 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982379 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982591 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982675 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982894 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.982991 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.983200 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.983362 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.983565 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.983864 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984112 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984248 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984449 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984548 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984789 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.984951 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985078 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985310 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985418 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985632 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985732 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.985953 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986059 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986259 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986364 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986558 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986656 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986865 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.986971 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987162 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987272 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987461 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987568 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987767 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.987865 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988085 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988192 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988391 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988487 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988691 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988796 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.988983 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989143 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989304 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989390 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989604 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989690 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989902 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.989996 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990201 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990286 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990496 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990580 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990792 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.990878 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991095 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991199 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991466 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991570 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991728 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.991812 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992002 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992102 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992306 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992414 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992604 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992702 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.992904 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993019 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993227 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993338 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993525 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993621 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993856 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.993963 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994153 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994268 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994488 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994585 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994801 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.994886 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995121 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995215 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995430 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995515 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995726 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.995809 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996032 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996118 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996330 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996414 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996627 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996712 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.996925 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997026 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997256 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997342 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997561 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997657 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997856 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.997949 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998160 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998245 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998462 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998548 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998765 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.998858 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.999686 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:35.999882 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000015 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000323 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000406 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000628 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000721 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.000937 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001065 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001269 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001356 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001575 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001659 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001879 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.001971 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002193 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002279 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002502 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002587 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002806 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.002891 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003105 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003193 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003413 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003510 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003711 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.003805 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004014 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004098 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004311 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004402 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004610 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004720 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.004906 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005010 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005235 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005322 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005539 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005634 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005842 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.005927 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006146 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006231 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006449 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006542 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006747 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.006832 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007042 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007141 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007347 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007468 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007641 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007779 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.007940 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008087 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008243 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008391 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008559 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008701 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.008868 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009025 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009256 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009343 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009559 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009856 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.009941 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010152 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010321 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010448 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010630 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010751 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.010939 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011047 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011247 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011332 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011547 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011638 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011849 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.011939 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012162 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012256 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012484 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012570 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012785 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.012869 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013112 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013198 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013415 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013534 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013712 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.013822 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.014020 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.014125 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.014329 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.014469 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.015274 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.015373 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.015585 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.015833 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.015918 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016174 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016270 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016492 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016578 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016802 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.016895 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017150 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017252 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017464 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017549 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017769 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.017876 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018081 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018174 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018390 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018476 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018695 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018778 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.018994 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019296 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019382 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019615 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019713 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.019924 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020007 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020225 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020309 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020538 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020630 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020854 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.020946 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021184 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021270 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021486 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021654 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021793 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.021901 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022099 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022230 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022404 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022539 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022708 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.022857 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023012 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023178 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023320 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023478 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023627 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023779 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.023901 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024088 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024207 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024390 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024520 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024689 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.024803 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025042 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025146 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025327 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025413 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025634 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025720 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.025943 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026028 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026250 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026336 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026549 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026848 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.026942 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.027166 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.027462 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.027547 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.027780 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.028086 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.028180 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.028405 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.028721 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.028827 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.029039 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.029360 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.029455 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.029668 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.029968 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.030202 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.030356 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.030665 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.030758 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031007 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031290 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031377 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031616 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031849 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.031975 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.032261 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.032418 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.032567 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.032900 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.032985 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.033260 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.033576 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.033661 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.033891 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.034188 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.034279 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.034497 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.034751 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.034841 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.035087 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.035388 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.035520 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.035687 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.035986 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.036161 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.036288 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.036586 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.036766 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.036884 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.037208 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.037398 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.037511 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.037730 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.037816 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038052 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038140 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038379 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038475 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038691 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038784 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.038992 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039078 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039290 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039374 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039610 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039701 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039911 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.039996 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040233 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040318 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040544 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040629 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040863 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.040957 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041211 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041299 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041522 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041618 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041844 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.041977 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042163 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042290 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042474 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042602 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042786 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.042923 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043094 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043245 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043405 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043567 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043717 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.043854 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044028 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044164 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044334 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044473 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044646 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044795 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.044956 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.045140 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.045290 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.045450 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.045864 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.045981 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.046236 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.046524 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.046619 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.046858 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.046944 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.047172 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.047486 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.047579 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.047799 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.047886 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048111 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048204 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048420 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048556 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048729 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.048880 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049071 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049217 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049392 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049540 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049709 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.049863 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050034 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050166 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050363 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050462 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050677 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050763 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.050988 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051073 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051301 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051399 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051613 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051706 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.051931 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052022 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052240 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052327 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052546 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052631 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052851 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.052937 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053174 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053262 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053476 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053563 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053782 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.053877 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.054330 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.054416 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.054639 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.054730 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.054944 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055037 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055249 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055341 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055557 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055688 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055855 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.055954 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056161 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056247 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056464 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056556 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056763 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.056857 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057182 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057394 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057481 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057729 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.057815 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058028 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058113 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058344 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058544 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058667 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058856 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.058989 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.059188 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.059277 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.059512 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.059606 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.059833 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.060109 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.060195 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.060442 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.060695 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.060781 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.061079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.061870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.061964 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.062210 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.062462 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.062552 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.062813 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.063008 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.063133 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.063442 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.063562 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.063743 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.064060 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.064145 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.064368 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.064668 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.064898 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.065266 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.065353 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.065580 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.065820 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.065986 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.066213 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.066399 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.066526 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.066828 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.066964 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.067150 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.067453 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.067540 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.067756 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068069 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068162 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068377 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068679 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068765 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.068978 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069114 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069307 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069419 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069614 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069700 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069914 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.069999 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070222 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070308 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070522 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070607 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070843 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.070929 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071147 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071239 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071447 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071540 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071749 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.071834 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072057 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072143 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072360 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072493 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072667 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072752 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.072969 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073091 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073295 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073381 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073605 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073700 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073905 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.073990 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074214 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074300 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074515 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074613 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074823 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.074909 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075124 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075210 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075429 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075526 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075742 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.075867 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076058 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076151 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076368 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076462 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076669 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.076891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.077017 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.077866 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.077976 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.078190 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.078501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.078584 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.078809 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.079131 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.079230 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.079546 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.079631 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.079869 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080078 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080188 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080411 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080507 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080729 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.080814 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081082 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081183 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081412 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081500 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081717 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.081803 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082019 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082118 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082322 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082407 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082648 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082735 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.082955 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083049 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083268 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083385 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083575 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083667 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083882 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.083977 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084188 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084274 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084493 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084596 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084799 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.084886 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085127 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085215 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085434 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085518 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085739 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.085826 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086042 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086127 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086347 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086441 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086651 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086736 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.086956 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087041 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087262 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087566 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087652 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087874 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.087959 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088181 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088282 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088489 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088586 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088802 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.088887 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089133 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089233 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089440 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089533 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089743 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.089829 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090046 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090132 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090358 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090557 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090683 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.090992 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.091198 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.091283 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.091520 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.091690 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.091840 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.092000 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.092151 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.092314 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.092463 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.092703 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093055 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093206 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093649 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093853 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.093952 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094165 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094260 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094483 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094568 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094785 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.094870 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095106 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095248 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095416 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095721 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.095815 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096042 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096135 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096345 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096429 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096645 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096873 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.096963 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097241 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097328 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097555 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097640 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097858 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.097945 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098157 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098249 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098455 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098541 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098761 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.098847 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099061 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099148 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099361 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099455 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099660 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099745 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.099957 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100042 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100261 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100356 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100558 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100642 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100855 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.100942 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101176 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101280 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101475 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101562 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101773 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.101858 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102072 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102166 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102375 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102467 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102679 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102812 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.102977 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103073 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103276 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103369 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103573 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103659 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103870 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.103966 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104171 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104257 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104475 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104560 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104776 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.104863 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105098 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105190 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105406 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105496 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105709 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.105797 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106014 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106100 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106313 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106407 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106620 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106706 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.106965 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107057 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107221 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107315 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107553 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107648 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107860 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.107947 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.108157 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.108267 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.108620 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.108706 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109069 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109156 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109383 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109482 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109694 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.109780 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110001 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110086 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110309 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110403 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110613 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110698 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.110936 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111021 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111251 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111467 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111553 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111800 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.111886 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112130 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112232 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112440 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112527 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112765 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.112891 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113182 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113396 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113482 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113698 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.113796 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114007 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114093 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114313 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114398 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114618 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114704 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.114925 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115011 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115231 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115317 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115536 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115630 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115845 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.115931 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116149 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116274 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116453 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116552 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116755 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.116842 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117081 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117171 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117387 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117487 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117689 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117777 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.117990 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118077 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118293 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118388 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118597 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118683 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.118930 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.119024 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.119242 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.119328 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.119480 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103801) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 14:26:36.119572 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.119848 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.120158 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.120460 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.120761 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.121086 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.121389 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.121697 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.122019 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.122325 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.122623 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.123033 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.123337 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.123650 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.124501 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.125072 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.125401 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.125727 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.126035 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.126355 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.126661 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.126983 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.127314 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.127634 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.127952 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.128252 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.128551 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.128849 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.129177 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.129491 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.129792 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.130087 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.130384 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.130685 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.130981 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.131276 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.131572 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.131866 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.132165 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.132459 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.132753 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.133077 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.133375 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.133670 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.133963 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.134262 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.134558 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.134856 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.135152 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.135450 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.135745 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.136069 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.136394 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.136702 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.137035 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.137340 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.137655 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.137959 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.138273 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.138585 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.138891 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.139192 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.139560 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.140590 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.141025 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.141339 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.141645 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.141953 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.142260 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.142581 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.142899 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.143199 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.143516 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.143827 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.144140 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.144449 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.144755 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.145109 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.145421 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.145727 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.146033 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.146339 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.146646 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.146956 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.147262 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.147568 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.147879 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.148191 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.148511 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.148833 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.149163 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.149483 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.149839 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.150140 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.150451 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.150790 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.151113 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.151421 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.151727 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.152026 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:26:36.152263 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103800) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 14:26:36.274244 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Registered counter for database nova_api Jul 29 14:26:36.296420 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.303169 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.310864 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Registered counter for database nova_api Jul 29 14:26:36.331357 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.337652 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.359386 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.context [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbe46424-675f-40f2-a0b6-2e5b8f5e805f(cell1) {{(pid=103801) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 14:26:36.363354 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:26:36.364918 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:26:36.365725 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:26:36.367707 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:26:36.369695 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Registered counter for database nova_cell0 Jul 29 14:26:36.375985 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Registered counter for database nova_cell1 Jul 29 14:26:36.383268 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.385777 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.389963 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.398892 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.context [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbe46424-675f-40f2-a0b6-2e5b8f5e805f(cell1) {{(pid=103800) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 14:26:36.402874 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:26:36.404458 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:26:36.405589 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:26:36.407782 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_concurrency.lockutils [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103800) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:26:36.409789 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Registered counter for database nova_cell0 Jul 29 14:26:36.415075 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Registered counter for database nova_cell1 Jul 29 14:26:36.422833 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.424145 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.430723 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.432961 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.526339 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.536288 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO dbcounter [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Registered counter for database nova_cell0 Jul 29 14:26:36.545046 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_db.sqlalchemy.engines [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103801) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.550205 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writer thread running {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.582943 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO dbcounter [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Registered counter for database nova_cell0 Jul 29 14:26:36.590230 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG oslo_db.sqlalchemy.engines [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103800) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:26:36.595179 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writer thread running {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:26:36.948577 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:26:36.956502 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:26:36.980628 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:26:36.988123 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:26:37.295675 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:26:37.302265 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: WARNING keystonemiddleware.auth_token [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:26:37.307733 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631b8e939c0 pid: 103801 (default app) Jul 29 14:26:37.309827 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:26:37.311006 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001761 Jul 29 14:26:37.311486 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Fri Jul 29 14:26:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:26:37.328090 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:26:37.334077 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: WARNING keystonemiddleware.auth_token [None req-bad30fb9-002d-4585-b910-3c4128c64ddb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:26:37.339316 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631b8e939c0 pid: 103800 (default app) Jul 29 14:27:56.380524 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:27:56.381548 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 29 14:27:56.382094 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:27:56.394355 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:27:56.395150 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell1:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:27:56.396259 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell0:SELECT=3 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:27:56.397496 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:27:57.301851 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f228b238-cc8d-4c05-a221-1401bff3b681 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:27:57.336139 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-f228b238-cc8d-4c05-a221-1401bff3b681 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.947549 Jul 29 14:27:57.341084 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 14:27:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:27:59.554077 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:27:59.555066 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-dddb42e8-7da8-4ef9-9ac7-db2bf0ad2b0a None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001698 Jul 29 14:27:59.555559 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:00.037763 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-20cb1cdb-9e03-4ae9-832f-45a40b19ef37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "c1", "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:00.058712 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:28:00.058712 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: warnings.warn(msg) Jul 29 14:28:00.136216 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-20cb1cdb-9e03-4ae9-832f-45a40b19ef37 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.574179 Jul 29 14:28:00.136780 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:27:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:00.151965 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:00.153136 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:00.154360 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell1:SELECT=3 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:00.155601 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:00.360271 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-a0b65b69-dfab-4d2d-8ec8-3ebb84f55793 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:00.364605 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:28:00.364605 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:28:00.497116 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-a0b65b69-dfab-4d2d-8ec8-3ebb84f55793 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.349858 Jul 29 14:28:00.497951 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 14:28:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:02.675661 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-20cb1cdb-9e03-4ae9-832f-45a40b19ef37 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:02.676747 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-20cb1cdb-9e03-4ae9-832f-45a40b19ef37 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jul 29 14:28:02.677342 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:03.347340 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-74df38c6-0b59-446c-b3fc-7d8e75f475c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "vcpus": 1, "name": "ds512M", "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:03.368444 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:28:03.368444 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:28:03.471989 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-74df38c6-0b59-446c-b3fc-7d8e75f475c3 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.788720 Jul 29 14:28:03.472730 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:03.484937 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6c42803d-d31c-4ae0-9dd6-d41ef024bb25 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:03.487742 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:28:03.487742 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: warnings.warn(msg) Jul 29 14:28:03.581557 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-6c42803d-d31c-4ae0-9dd6-d41ef024bb25 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100730 Jul 29 14:28:03.582410 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 14:28:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:05.759428 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-74df38c6-0b59-446c-b3fc-7d8e75f475c3 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:05.760451 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-74df38c6-0b59-446c-b3fc-7d8e75f475c3 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jul 29 14:28:05.760858 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:06.158290 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-e2d5963f-f5b3-4086-ba73-91dcd93697b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "id": "d2"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:06.241995 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-e2d5963f-f5b3-4086-ba73-91dcd93697b1 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475074 Jul 29 14:28:06.242489 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:28:06.254422 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-09e9802e-44c1-4842-ab7f-ccfd87c5c5cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:06.328480 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-09e9802e-44c1-4842-ab7f-ccfd87c5c5cf admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077756 Jul 29 14:28:06.329075 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 14:28:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:28:08.565043 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-e2d5963f-f5b3-4086-ba73-91dcd93697b1 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:08.566070 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-e2d5963f-f5b3-4086-ba73-91dcd93697b1 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jul 29 14:28:08.566471 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:09.024643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-eb0ae3b9-11a0-4f20-a150-3ba8bc3f86e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:09.104703 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-eb0ae3b9-11a0-4f20-a150-3ba8bc3f86e0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.532407 Jul 29 14:28:09.105469 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:28:09.117915 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-47fcc4bb-736a-4388-a191-00ebc76fb1a5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:09.215735 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-47fcc4bb-736a-4388-a191-00ebc76fb1a5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101326 Jul 29 14:28:09.216317 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 14:28:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:11.416296 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-eb0ae3b9-11a0-4f20-a150-3ba8bc3f86e0 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:11.417255 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-eb0ae3b9-11a0-4f20-a150-3ba8bc3f86e0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jul 29 14:28:11.417930 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:11.849370 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "name": "ds4G", "disk": 20, "vcpus": 4}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:11.922831 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.496748 Jul 29 14:28:11.923471 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:28:11.935868 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-7ec9a1b5-0403-4fb3-b1a2-09ebe94e619e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:11.994683 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-7ec9a1b5-0403-4fb3-b1a2-09ebe94e619e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.062577 Jul 29 14:28:11.995631 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Fri Jul 29 14:28:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:14.245834 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:14.246967 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Jul 29 14:28:14.247475 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:14.709821 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-000d12ab-2b86-4e61-a4a0-dc43ba1946b9 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:14.734371 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-000d12ab-2b86-4e61-a4a0-dc43ba1946b9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.479433 Jul 29 14:28:14.735232 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 14:28:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:16.935425 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:16.937615 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-1fddd8dd-9a80-4c2d-9521-c963a76dcb2a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jul 29 14:28:16.937615 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:17.359651 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-40e7f7da-160d-445a-85fd-f7c78f5e557a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "1", "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:17.442445 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-40e7f7da-160d-445a-85fd-f7c78f5e557a admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.497428 Jul 29 14:28:17.443205 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:28:17.455953 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-91e625db-d010-4b75-a575-a336f89bd5d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:17.541197 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-91e625db-d010-4b75-a575-a336f89bd5d8 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089372 Jul 29 14:28:17.541781 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 14:28:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:28:19.736261 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-40e7f7da-160d-445a-85fd-f7c78f5e557a admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:19.737331 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-40e7f7da-160d-445a-85fd-f7c78f5e557a admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Jul 29 14:28:19.737730 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:20.130611 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-a8a6d0a8-5c4b-4a85-aed8-7f525b645ae4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:20.204256 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-a8a6d0a8-5c4b-4a85-aed8-7f525b645ae4 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460351 Jul 29 14:28:20.204815 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:20.216381 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-51ab4154-9832-451a-be36-444409340c7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:20.303555 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-51ab4154-9832-451a-be36-444409340c7c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090685 Jul 29 14:28:20.304431 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 14:28:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:22.508187 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-a8a6d0a8-5c4b-4a85-aed8-7f525b645ae4 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:22.509166 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-a8a6d0a8-5c4b-4a85-aed8-7f525b645ae4 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 29 14:28:22.509563 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:22.885501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bf2f6792-f0c7-4198-9443-da92d025e096 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "os-flavor-access:is_public": true, "ram": 4096, "name": "m1.medium"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:22.947876 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bf2f6792-f0c7-4198-9443-da92d025e096 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.431417 Jul 29 14:28:22.948590 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:22 2022] POST /compute/v2.1/flavors => generated 406 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:22.960807 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-d8640ed6-ed9d-4bb5-bc18-abe2570911b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:23.033333 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-d8640ed6-ed9d-4bb5-bc18-abe2570911b5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076225 Jul 29 14:28:23.033908 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 14:28:22 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:25.295963 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bf2f6792-f0c7-4198-9443-da92d025e096 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:25.298950 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bf2f6792-f0c7-4198-9443-da92d025e096 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005201 Jul 29 14:28:25.299365 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:25 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:25.750341 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9dcf9c63-80b5-45db-b6c5-572d31de1ccc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:25.825237 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9dcf9c63-80b5-45db-b6c5-572d31de1ccc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.519205 Jul 29 14:28:25.825713 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:25.838085 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-1e58d7a4-703e-4fba-81de-53b99f6c7fe2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:25.914579 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-1e58d7a4-703e-4fba-81de-53b99f6c7fe2 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080095 Jul 29 14:28:25.915526 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 14:28:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:28.162184 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9dcf9c63-80b5-45db-b6c5-572d31de1ccc admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:28.163278 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9dcf9c63-80b5-45db-b6c5-572d31de1ccc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 29 14:28:28.165976 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:28.596862 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.xlarge", "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "vcpus": 8, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:28.685669 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.515757 Jul 29 14:28:28.686976 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Fri Jul 29 14:28:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:28.698373 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-ce1d690e-4aaf-4237-9e16-8df60081ee8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:28.703757 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:28.825025 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-ce1d690e-4aaf-4237-9e16-8df60081ee8c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130182 Jul 29 14:28:28.825834 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Fri Jul 29 14:28:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:28:49.732863 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:49.734650 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 29 14:28:49.735057 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:28:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:50.163802 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-3e395a9b-8929-4941-8446-899fa616eccc admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:50.185707 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-3e395a9b-8929-4941-8446-899fa616eccc admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.441209 Jul 29 14:28:50.185707 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 14:28:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:51.248510 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:51.249690 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-f736c195-e114-4b34-b499-e581800b8217 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jul 29 14:28:51.250083 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:51.766549 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f90b4690-bd92-4b8c-aed5-317a8a828ab1 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:51.772059 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-f90b4690-bd92-4b8c-aed5-317a8a828ab1 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f90b4690-bd92-4b8c-aed5-317a8a828ab1 admin admin] Request method failure captured: Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Host: 10.222.0.49 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi4-6jBgcsHW48tiH1aebIqarJ_8AOcX9jMrHwF8pQA1cz2c3qyyB6K_t_B2gO8QQthk_DQKkIvduwAzEQhBIEql5Jw2vXTGsW6s6JFnymmC4v1vmWkkEJKBC9gAu1jlSuWzbCU2kDq1meI3tuhzkBeFYwJQ5jcNzlP67x_hZe_991w1c Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Role: member,reader,admin Jul 29 14:28:51.775282 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Roles: member,reader,admin Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User: admin Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: method: > Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: exception: Flavor 42 could not be found. Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: action_args: {'id': '42'} Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:51.776941 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:51.777870 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-f90b4690-bd92-4b8c-aed5-317a8a828ab1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:51.780533 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-f90b4690-bd92-4b8c-aed5-317a8a828ab1 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.390365 Jul 29 14:28:51.780533 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 14:28:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 14:28:51.786643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-919b2f2a-eaa4-4716-b9f9-6d5ece822074 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:51.790871 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:28:51.809610 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-919b2f2a-eaa4-4716-b9f9-6d5ece822074 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026551 Jul 29 14:28:51.810165 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:51.820431 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-b8a22b60-e148-4b7d-8f8c-d8777fd82561 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:51.844951 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-b8a22b60-e148-4b7d-8f8c-d8777fd82561 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028246 Jul 29 14:28:51.845506 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:28:51.855038 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-7f92d871-cda3-4260-b974-008d2d0db454 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:51.861305 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-7f92d871-cda3-4260-b974-008d2d0db454 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-7f92d871-cda3-4260-b974-008d2d0db454 admin admin] Request method failure captured: Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Host: 10.222.0.49 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi4-6jBgcsHW48tiH1aebIqarJ_8AOcX9jMrHwF8pQA1cz2c3qyyB6K_t_B2gO8QQthk_DQKkIvduwAzEQhBIEql5Jw2vXTGsW6s6JFnymmC4v1vmWkkEJKBC9gAu1jlSuWzbCU2kDq1meI3tuhzkBeFYwJQ5jcNzlP67x_hZe_991w1c Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Role: member,reader,admin Jul 29 14:28:51.864705 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Roles: member,reader,admin Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User: admin Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: method: > Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: exception: Flavor 42 could not be found. Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: action_args: {'id': '42'} Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:51.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:51.880346 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:51.881458 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-7f92d871-cda3-4260-b974-008d2d0db454 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:51.882542 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-7f92d871-cda3-4260-b974-008d2d0db454 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014884 Jul 29 14:28:51.882542 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 14:28:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 29 14:28:52.826034 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-b8a22b60-e148-4b7d-8f8c-d8777fd82561 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:52.827032 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-b8a22b60-e148-4b7d-8f8c-d8777fd82561 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 29 14:28:52.828489 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:53.354926 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0154ad9f-cce9-4e9c-af16-e0b05a437021 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:53.360408 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-0154ad9f-cce9-4e9c-af16-e0b05a437021 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0154ad9f-cce9-4e9c-af16-e0b05a437021 admin admin] Request method failure captured: Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Host: 10.222.0.49 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi4-6kOG3sQndzNLsuhmDKnzcCvo1kKZcy4lNgrfBJzSMk_NEjaRuY-SqvVudu5oiDmnSojAl6rfM7aX2FqGbOM-rE4285H3fnp2-my6ditihHVOV6FVCBYHbIsMAcpM4uPAb73k0xognIkwtYn9losJcms_OVmNoLwF2m6lNy0QHVTlw Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Role: member,reader,admin Jul 29 14:28:53.361922 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Roles: member,reader,admin Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User: admin Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: method: > Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: exception: Flavor 84 could not be found. Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: action_args: {'id': '84'} Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:53.363538 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:53.364501 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.365666 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-0154ad9f-cce9-4e9c-af16-e0b05a437021 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:53.366685 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-0154ad9f-cce9-4e9c-af16-e0b05a437021 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396901 Jul 29 14:28:53.366685 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 14:28:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 14:28:53.372854 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-86051e28-4fe1-4e37-bfb1-9a31ccf7216b admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:53.388141 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-86051e28-4fe1-4e37-bfb1-9a31ccf7216b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018822 Jul 29 14:28:53.388681 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:53.398424 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-00093478-a217-44fa-a40f-42275b902160 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:53.413283 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-00093478-a217-44fa-a40f-42275b902160 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018238 Jul 29 14:28:53.413806 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:53.423833 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-533b2b79-e231-4f9f-b630-6e522bfccc96 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:53.429429 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-533b2b79-e231-4f9f-b630-6e522bfccc96 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-533b2b79-e231-4f9f-b630-6e522bfccc96 admin admin] Request method failure captured: Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Host: 10.222.0.49 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi4-6kOG3sQndzNLsuhmDKnzcCvo1kKZcy4lNgrfBJzSMk_NEjaRuY-SqvVudu5oiDmnSojAl6rfM7aX2FqGbOM-rE4285H3fnp2-my6ditihHVOV6FVCBYHbIsMAcpM4uPAb73k0xognIkwtYn9losJcms_OVmNoLwF2m6lNy0QHVTlw Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Role: member,reader,admin Jul 29 14:28:53.430919 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Roles: member,reader,admin Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User: admin Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: method: > Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: exception: Flavor 84 could not be found. Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: action_args: {'id': '84'} Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:53.432430 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:53.433424 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:53.434749 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-533b2b79-e231-4f9f-b630-6e522bfccc96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:53.436048 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-533b2b79-e231-4f9f-b630-6e522bfccc96 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012620 Jul 29 14:28:53.436048 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Fri Jul 29 14:28:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 14:28:54.393086 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-00093478-a217-44fa-a40f-42275b902160 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:54.394112 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-00093478-a217-44fa-a40f-42275b902160 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 29 14:28:54.394500 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:54.914248 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f2ad0a4-5b6e-46a0-ab69-c311a552cdf9 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:54.919910 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.wsgi [None req-6f2ad0a4-5b6e-46a0-ab69-c311a552cdf9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f2ad0a4-5b6e-46a0-ab69-c311a552cdf9 admin admin] Request method failure captured: Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept: application/json Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Accept-Encoding: gzip, deflate Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Connection: keep-alive Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Content-Length: 0 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Host: 10.222.0.49 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Openstack-System-Scope: None Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: User-Agent: python-novaclient Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Auth-Token: gAAAAABi4-6mhWWa2u-K9ZTrZE5C5MEM2PMUfUboPD4rTAOl6Tc_pB1Cr5MyrYeygtSa-DxPEozH6eNfoYb0UPuqsVY7krXEqxx1ZsY7LB-noak6wsltdRmdkqre-YOFHIvoA3U9FzO7o7qNuSOIJeGsk2vRxTZsJMmkdHt7xELwl2CgJF_Iwvo Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Id: None Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Domain-Name: None Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Identity-Status: Confirmed Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Is-Admin-Project: True Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Id: default Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Domain-Name: Default Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Project-Name: admin Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Role: member,reader,admin Jul 29 14:28:54.922569 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Roles: member,reader,admin Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant: admin Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-Tenant-Name: admin Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User: admin Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Id: default Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Domain-Name: Default Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: X-User-Name: admin Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: method: > Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: exception: Flavor 451 could not be found. Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: action_args: {'id': '451'} Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:54.924092 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:54.924889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.926284 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-6f2ad0a4-5b6e-46a0-ab69-c311a552cdf9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103800) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:54.927637 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-6f2ad0a4-5b6e-46a0-ab69-c311a552cdf9 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.392066 Jul 29 14:28:54.927637 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:28:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 14:28:54.933832 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-2bfbdbbb-a112-44e4-9cdd-25f76578230b admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:54.949234 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-2bfbdbbb-a112-44e4-9cdd-25f76578230b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018954 Jul 29 14:28:54.949763 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:54.959442 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:54.974091 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018164 Jul 29 14:28:54.974617 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Fri Jul 29 14:28:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:28:54.984288 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-88f78f09-c3e3-49bf-9115-36f062536992 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:54.989592 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.wsgi [None req-88f78f09-c3e3-49bf-9115-36f062536992 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-88f78f09-c3e3-49bf-9115-36f062536992 admin admin] Request method failure captured: Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept: application/json Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Accept-Encoding: gzip, deflate Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Connection: keep-alive Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Content-Length: 0 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Host: 10.222.0.49 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-Api-Version: compute 2.90 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Openstack-System-Scope: None Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: User-Agent: python-novaclient Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Auth-Token: gAAAAABi4-6mhWWa2u-K9ZTrZE5C5MEM2PMUfUboPD4rTAOl6Tc_pB1Cr5MyrYeygtSa-DxPEozH6eNfoYb0UPuqsVY7krXEqxx1ZsY7LB-noak6wsltdRmdkqre-YOFHIvoA3U9FzO7o7qNuSOIJeGsk2vRxTZsJMmkdHt7xELwl2CgJF_Iwvo Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Id: None Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Domain-Name: None Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Identity-Status: Confirmed Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Is-Admin-Project: True Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Openstack-Nova-Api-Version: 2.90 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Id: default Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Domain-Name: Default Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Project-Name: admin Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Role: member,reader,admin Jul 29 14:28:54.991079 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Roles: member,reader,admin Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/70f7d9422ed44219ac78a91471e7dbb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/70f7d9422ed44219ac78a91471e7dbb9"}]}] Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant: admin Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Id: 70f7d9422ed44219ac78a91471e7dbb9 Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-Tenant-Name: admin Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User: admin Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Id: default Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Domain-Name: Default Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Id: 4c8c97aa5a724434b6ecf6c70f044b44 Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: X-User-Name: admin Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: method: > Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: exception: Flavor 451 could not be found. Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: action_args: {'id': '451'} Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:28:54.992643 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:54.993819 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: ERROR nova.api.openstack.wsgi Jul 29 14:28:54.995138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-88f78f09-c3e3-49bf-9115-36f062536992 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103801) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:28:54.996423 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-88f78f09-c3e3-49bf-9115-36f062536992 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012253 Jul 29 14:28:54.996423 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:28:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 29 14:28:55.963761 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:55.964754 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Jul 29 14:28:55.965173 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:56.495125 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-d1d137ff-4145-4d66-b3be-81a40c3e9e38 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:56.639138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-d1d137ff-4145-4d66-b3be-81a40c3e9e38 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.537852 Jul 29 14:28:56.640197 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 14:28:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:57.605831 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:57.606836 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 29 14:28:57.607226 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:58.130848 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-b08d5ff9-c947-4690-8ab1-5f128b7b6c13 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:58.199235 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-b08d5ff9-c947-4690-8ab1-5f128b7b6c13 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.453826 Jul 29 14:28:58.199788 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 14:28:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:28:59.194459 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:28:59.195513 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jul 29 14:28:59.195903 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:28:59.721287 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-20bf9e42-8fbe-42b7-b786-57305d3e4c89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:28:59.819849 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-20bf9e42-8fbe-42b7-b786-57305d3e4c89 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.485891 Jul 29 14:28:59.820396 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 14:28:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:29:00.783834 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:00.784851 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 29 14:29:00.785280 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:29:01.302462 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-dc2b5ebb-191d-4214-8ba2-f3b4bfb81911 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:29:01.372298 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-dc2b5ebb-191d-4214-8ba2-f3b4bfb81911 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.450096 Jul 29 14:29:01.372880 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Fri Jul 29 14:29:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:29:02.344427 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:02.345473 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Jul 29 14:29:02.345867 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:29:02.866547 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-14dd7f91-0649-440d-9f51-bf68729f2e69 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:02.886517 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-14dd7f91-0649-440d-9f51-bf68729f2e69 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.403098 Jul 29 14:29:02.887041 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Fri Jul 29 14:29:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:29:54.244048 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.245354 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-94e76de9-f083-4140-8dc6-c585bd7a1c03 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001705 Jul 29 14:29:54.245751 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:29:54.256797 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:29:54.634243 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-5dda6860-490e-449a-b900-4a5e0b00d706 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.655164 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-5dda6860-490e-449a-b900-4a5e0b00d706 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.402701 Jul 29 14:29:54.655758 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:29:54.678892 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-0e7e6e70-da00-40f0-950a-f8d3fce6a339 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.682642 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG dbcounter [-] [103800] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103800) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:29:54.688061 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-0e7e6e70-da00-40f0-950a-f8d3fce6a339 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012748 Jul 29 14:29:54.688577 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:29:54.700083 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-bac4ecb3-d1a0-487c-aee2-322c3e63a949 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.708454 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-bac4ecb3-d1a0-487c-aee2-322c3e63a949 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011947 Jul 29 14:29:54.709529 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:29:54.721223 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.729286 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011980 Jul 29 14:29:54.729798 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:29:54.740935 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-91dc2c32-3c55-4509-8cd9-0249ea329617 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:29:54.748449 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-91dc2c32-3c55-4509-8cd9-0249ea329617 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011088 Jul 29 14:29:54.749586 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Fri Jul 29 14:29:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:33:31.836031 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:31.837169 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 Jul 29 14:33:31.837568 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:33:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:33:31.986184 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=6 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:33:32.144940 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:32.147351 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:33:32.147351 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:33:32.148670 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:32.149138 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:32.149936 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:32.150364 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:32.185782 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-600bba9a-aee3-45ab-8a60-3d39752a66d3 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201059 Jul 29 14:33:32.186341 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:33:31 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:33:33.014884 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:33.015928 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 29 14:33:33.016319 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:33:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:33:33.208879 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:33.211329 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:33:33.211329 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:33:33.212550 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:33.213016 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:33.213800 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:33.214225 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:33.233239 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-47b52cf4-a3c4-4a2d-83e4-494891bcab79 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076937 Jul 29 14:33:33.233723 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:33:33 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:33:44.458872 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:44.459936 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 29 14:33:44.460328 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:33:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:33:44.604008 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell0:SELECT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:33:44.606190 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_cell1:SELECT=4 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:33:44.606969 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG dbcounter [-] [103801] Writing DB stats nova_api:SELECT=8 {{(pid=103801) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:33:44.660396 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:44.662774 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:33:44.662774 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:33:44.663976 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:44.664421 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:44.665231 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:44.665665 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:44.691778 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-c7344196-a9de-4523-abd2-4f5dfe75ecd1 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.092227 Jul 29 14:33:44.692344 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:33:44 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:33:45.528889 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: DEBUG nova.api.openstack.wsgi [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] Calling method '>' {{(pid=103800) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:45.529921 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: INFO nova.api.openstack.requestlog [None req-9d448a47-b172-4045-90ea-130591237b34 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Jul 29 14:33:45.530350 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: [pid: 103800|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Fri Jul 29 14:33:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:33:45.723570 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG nova.api.openstack.wsgi [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] Calling method '>' {{(pid=103801) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:33:45.725999 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 29 14:33:45.725999 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: warnings.warn(msg) Jul 29 14:33:45.727226 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:45.727675 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:45.728468 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:33:45.728898 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: DEBUG oslo_concurrency.lockutils [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103801) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:33:45.750480 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: INFO nova.api.openstack.requestlog [None req-89cbb586-e4b8-47af-8df6-9f9a19a5d595 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079012 Jul 29 14:33:45.751031 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: [pid: 103801|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Fri Jul 29 14:33:45 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:34:42.582940 dv-cinder-799871-49-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 29 14:34:42.583680 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: Fri Jul 29 14:34:42 2022 - graceful shutdown triggered... Jul 29 14:34:42.584186 dv-cinder-799871-49-iscsi devstack@n-api.service[103800]: Gracefully killing worker 1 (pid: 103800)... Jul 29 14:34:42.584569 dv-cinder-799871-49-iscsi devstack@n-api.service[103801]: Gracefully killing worker 2 (pid: 103801)... Jul 29 14:34:43.584700 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: worker 1 buried after 1 seconds Jul 29 14:34:43.585261 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: worker 2 buried after 1 seconds Jul 29 14:34:43.585261 dv-cinder-799871-49-iscsi devstack@n-api.service[103799]: goodbye to uWSGI. Jul 29 14:34:43.586342 dv-cinder-799871-49-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 29 14:34:43.586889 dv-cinder-799871-49-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 29 14:34:43.589730 dv-cinder-799871-49-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 29 14:34:43.602177 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 29 14:34:43 2022] *** Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: nodename: dv-cinder-799871-49-iscsi Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: machine: x86_64 Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: clock source: unix Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: pcre jit disabled Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: detected number of CPU cores: 4 Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: current working directory: / Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: detected binary path: /usr/bin/uwsgi-core Jul 29 14:34:43.604789 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: your processes number limit is 47680 Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: your memory page size is 4096 bytes Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: detected max file descriptor number: 2048 Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: lock engine: pthread robust mutexes Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: thunder lock: enabled Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 29 14:34:43.605777 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 29 14:34:43.646360 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: Python main interpreter initialized at 0x55ad2f42b9c0 Jul 29 14:34:43.646360 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: python threads support enabled Jul 29 14:34:43.646360 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: your server socket listen backlog is limited to 100 connections Jul 29 14:34:43.646360 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: your mercy for graceful operations on workers is 90 seconds Jul 29 14:34:43.646812 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: mapped 403077 bytes (393 KB) for 2 cores Jul 29 14:34:43.646812 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: *** Operational MODE: preforking *** Jul 29 14:34:43.647076 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: *** uWSGI is running in multiple interpreter mode *** Jul 29 14:34:43.647076 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: spawned uWSGI master process (pid: 124758) Jul 29 14:34:43.647277 dv-cinder-799871-49-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 29 14:34:43.647847 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: spawned uWSGI worker 1 (pid: 124771, cores: 1) Jul 29 14:34:43.648394 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: spawned uWSGI worker 2 (pid: 124772, cores: 1) Jul 29 14:34:43.648642 dv-cinder-799871-49-iscsi devstack@n-api.service[124758]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 29 14:34:44.309758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 14:34:44.311847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 29 14:34:45.475937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:34:45.475937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: from cryptography.utils import int_from_bytes Jul 29 14:34:45.476699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:34:45.476699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: from cryptography.utils import int_from_bytes Jul 29 14:34:45.496550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:34:45.496550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: from cryptography.utils import int_from_bytes Jul 29 14:34:45.497149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 29 14:34:45.497149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: from cryptography.utils import int_from_bytes Jul 29 14:34:47.895975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 14:34:47.896538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 14:34:47.896851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 14:34:47.897190 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 14:34:47.897453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 14:34:47.897851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.898181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.898523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.898840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.899172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.899490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.899817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.900144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.900478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.900747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.901095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.901429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-49-iscsi {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.901760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.902237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.902559 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.902889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.903206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.903538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.903895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.904362 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.905827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.905827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.905827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.905827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.906183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.906458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.906733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.907053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.907922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.908250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.908655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-49-iscsi {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.909161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.909494 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.909803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.910247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.910563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.910682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 29 14:34:47.911095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.911183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 29 14:34:47.911264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.911502 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 29 14:34:47.911627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.911816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 29 14:34:47.911937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.912023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 29 14:34:47.912228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.912434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.912548 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.912755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.912870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.913851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914043 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914477 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.914997 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915113 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.915898 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-49-iscsi {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916301 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916506 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.916948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917470 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.917941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918097 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918564 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.918914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.919914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920220 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.920875 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921376 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.921992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-49-iscsi {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.922919 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.923105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.923881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.924454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.924623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.924780 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.925327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.925327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.925642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.925802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.925949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926424 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.926866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.927768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.928978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.929924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.930846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.931129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.931129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.931693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932463 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932616 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.932921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.933155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.933393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.933565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.934766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.934955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.935464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.935638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.935787 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.935934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.936847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.937011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.937191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.937340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.937500 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.937655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.938220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.938379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.938535 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939201 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.939979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.940897 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941387 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.941849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942007 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.942937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943534 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943687 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.943990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.944163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.944708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.944872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.945107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.945107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.945767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.945933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946468 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946780 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.946935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.947101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.947256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.947411 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.947567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.947758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.947920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.948068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.948215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.948377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.948532 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.948686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.948841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.949025 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.949181 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.949346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.949346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.949346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.949346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.949907 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.950062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.950211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.950365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.950519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.950665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.950810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.950975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.951137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.951292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.951448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.951601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.951761 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.951907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.952052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.952205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.952360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.952507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.952653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.952806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.952963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.953719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.953891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.954040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.954319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.954319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.955947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.956136 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.956291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.956438 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.956592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.956739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.956899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.957083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.957245 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.957402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.957557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.957712 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.957866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.958099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.958792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.958963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.959114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.959260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.959415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.959588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.959738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.959885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.960041 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.960188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.960347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.960495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.960688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.960849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.961061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.961229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.961391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.961538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.961708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.961866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.962062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.962223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.962223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.962520 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.962675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.962830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.962985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 29 14:34:47.963132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.966466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.966643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.966643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.966956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.967116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.967281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.967570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.967763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.967926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.968859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969075 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.969860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.970960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971265 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971425 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.971880 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972816 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.972981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.973948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974251 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.974855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.975009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.975181 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.975329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.975475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.975740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.976610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.976781 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.976941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977115 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977275 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.977882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.978964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979567 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.979862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.980848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981167 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981330 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.981943 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982090 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.982992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983440 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.983898 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.984979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.985166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.985323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.985477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.985790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.986054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.986905 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987502 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987651 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987812 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.987968 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.988851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989030 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.989950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990094 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.990906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991210 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.991974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.992902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993843 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.993843 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994279 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994579 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.994895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995494 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.995844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.996006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.996160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.997858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998322 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998484 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998794 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.998940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999092 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:47.999878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000788 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.000933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.001726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.001935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.002102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.002307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.002522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.002693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.002857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003788 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.003941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.004099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.004273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.004571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.004741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.004904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005094 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.005940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.006100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.006252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.006898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.007268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.007444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.007600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.007753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.007913 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.008076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.008243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.008403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.008563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.008744 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009031 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009482 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.009975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.010942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011426 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011746 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.011910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012389 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012552 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.012864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013038 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.013853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014005 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014484 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.014888 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.015835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.016056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.016225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.016380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.016549 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018313 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018646 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.018967 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.019775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.020498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.020651 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.020804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.020963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021319 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.021950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022270 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022727 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.022887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.023929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.024083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.024243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.024404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.024572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.024754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.025999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.026233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.026403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.026571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.026725 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.026979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.027147 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.027309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.027463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.028439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.029833 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.030007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.030420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.030590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.030766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.031510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.031706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.035794 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036255 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.036986 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.037235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.037395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.037550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.037724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.037930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038489 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.038970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.039952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.040918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.041177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.041348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.041767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.041927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.042123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.042310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.042470 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.042633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.042795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.043875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044628 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044776 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.044920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.045328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.045485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.045637 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.045792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.045792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046628 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.046939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.047941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048675 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.048954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049090 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049378 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049472 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.049925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.050933 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.051924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052513 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052608 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.052866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.064734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.064734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.064734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.064734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.064734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065185 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065332 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.065788 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066309 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066725 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.066942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.067918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068000 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068326 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068559 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068632 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.068928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069822 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.069981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070668 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070748 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.070977 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.071047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.071117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.071186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.071895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.072031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.072162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.072299 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.072448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.073117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.073488 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.074936 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075520 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.075943 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076878 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.076971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077613 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077698 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.077968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.078943 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.079036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.079132 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.079219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.079857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.079959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.080917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081122 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.081917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082032 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082214 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.082674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083714 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.083893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.084985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085092 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085254 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085432 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.085871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.086961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087197 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087271 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087351 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087595 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.087961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088305 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.088895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089331 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089517 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.089966 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.090965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091710 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.091983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092414 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092676 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092676 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.092926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093480 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093480 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.093919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094278 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.094795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.095428 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.095564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.095825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.095922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096390 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096968 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.096968 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.097200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.098756 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.098852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.098852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.098998 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.098998 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099379 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.099932 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.100978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101167 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101313 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101723 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101807 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.101985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.102930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103168 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.103942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104440 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104611 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.104956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.105999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106251 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.106906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107073 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.107813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108041 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.108864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109338 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.109907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.110005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.110276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.110394 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111641 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.111973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.112103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.112314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.112633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.112761 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.112951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.113099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.113498 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.113782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.113907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114133 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.114999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.115772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.116045 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.116189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.118938 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119467 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.119985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.120952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.121924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122134 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122552 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.122859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123077 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.123852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124191 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.124974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.125137 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.127918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128631 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.128981 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129198 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.129921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130316 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.130953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.131980 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.132161 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.132490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.132593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.132857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.132971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.133226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.133340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.133538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.133647 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.133913 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134013 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134165 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.134912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135270 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.135848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.136984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.137952 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138569 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.138982 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139309 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.139932 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140136 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140756 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.140857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.141102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.141215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.141396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.141521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.141709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.142384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.142654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.142764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.143949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.144099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.144275 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.144424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.144564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.144667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.145051 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.155621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.156330 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.156483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.156612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.156768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.156901 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.157104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.157104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.157465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.158886 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159137 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159255 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159647 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.159980 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160514 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.160959 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161685 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.161975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.162957 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163077 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.163991 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164075 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164331 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164427 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.164941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165710 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.165968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166426 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166621 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.166970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167393 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167656 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.167910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168004 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168363 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.168976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169786 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.169968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170054 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170152 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170440 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.170938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171309 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.171928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.172897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173316 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.173953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174632 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.174964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175675 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175761 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.175931 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176016 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176470 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124771) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.176806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.177946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.178246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.178574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.178882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.179209 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.179529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.179853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.180302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.180616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.180952 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.184206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.185085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.185085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.185414 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.185643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.185924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.187958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.188332 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.188717 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.189125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.189465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.189833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.190464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.190804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.191132 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.191453 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 29 14:34:48.191706 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124772) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 29 14:34:48.236196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Registered counter for database nova_api Jul 29 14:34:48.254005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO dbcounter [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Registered counter for database nova_api Jul 29 14:34:48.256646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.263413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.274980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_db.sqlalchemy.engines [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.282114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writer thread running {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.320959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.context [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbe46424-675f-40f2-a0b6-2e5b8f5e805f(cell1) {{(pid=124771) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 14:34:48.325195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:34:48.326817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:34:48.327660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:34:48.330339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:34:48.332337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Registered counter for database nova_cell0 Jul 29 14:34:48.336398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Registered counter for database nova_cell1 Jul 29 14:34:48.340958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.context [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cbe46424-675f-40f2-a0b6-2e5b8f5e805f(cell1) {{(pid=124772) load_cells /opt/stack/nova/nova/context.py:464}} Jul 29 14:34:48.344168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.345993 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:34:48.346671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.357167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:34:48.357167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:34:48.357167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:34:48.357167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO dbcounter [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Registered counter for database nova_cell0 Jul 29 14:34:48.357561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.357561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.357732 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO dbcounter [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Registered counter for database nova_cell1 Jul 29 14:34:48.364274 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_db.sqlalchemy.engines [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.365650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_db.sqlalchemy.engines [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.373339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writer thread running {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.373681 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writer thread running {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.502303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO dbcounter [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Registered counter for database nova_cell0 Jul 29 14:34:48.508888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_db.sqlalchemy.engines [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124771) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.513442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writer thread running {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.521107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO dbcounter [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Registered counter for database nova_cell0 Jul 29 14:34:48.530708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_db.sqlalchemy.engines [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124772) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 29 14:34:48.535404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writer thread running {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 29 14:34:48.836706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:34:48.843977 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:34:48.858026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: WARNING keystonemiddleware.auth_token [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:34:48.865937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: WARNING keystonemiddleware.auth_token [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:34:49.193872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:34:49.199928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: WARNING keystonemiddleware.auth_token [None req-15fb5773-6653-4d71-aa6b-02f9f2535e30 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:34:49.205929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad2f42b9c0 pid: 124771 (default app) Jul 29 14:34:49.212736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: WARNING keystonemiddleware.auth_token [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 29 14:34:49.218759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: WARNING keystonemiddleware.auth_token [None req-70bf68e6-7c7c-42db-8d2e-a967605b4920 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 29 14:34:49.224710 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad2f42b9c0 pid: 124772 (default app) Jul 29 14:35:31.309603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:31.312168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:31.313343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:31.315679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:32.584161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1a605bb6-aed4-4bf8-a8c6-8c1bc901a8af tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Action: 'create', calling method: .version_select at 0x7f68121e7f70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1917843812", "metadata": {"Type": "work"}}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1a605bb6-aed4-4bf8-a8c6-8c1bc901a8af tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 122 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:35:32.591904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1917843812", "metadata": {"Type": "work"}}} Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: Jul 29 14:35:32.593620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1917843812', 'metadata': {'Type': 'work'}}}} Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise error Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi '#$%' Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:32.596302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 14:35:32.599281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 14:35:32.601632 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 29 14:35:32.601632 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.602729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1a605bb6-aed4-4bf8-a8c6-8c1bc901a8af tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:32.603524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1a605bb6-aed4-4bf8-a8c6-8c1bc901a8af tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.315233 Jul 29 14:35:32.612877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 14:35:31 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1319 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:35:32.928488 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6882773a-a0fb-455e-bfb9-d7e24d011427 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Action: 'create', calling method: .version_select at 0x7f681222ca60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-840827926", "metadata": {"Type": "work"}}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6882773a-a0fb-455e-bfb9-d7e24d011427 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 119 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:35:32.949239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-840827926", "metadata": {"Type": "work"}}} Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:35:32.950862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-840827926', 'metadata': {'Type': 'work'}}}} Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise error Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi '0' Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:32.951814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 14:35:32.953442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 14:35:32.954811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 29 14:35:32.954811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:32.966447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6882773a-a0fb-455e-bfb9-d7e24d011427 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:32.984573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6882773a-a0fb-455e-bfb9-d7e24d011427 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.371128 Jul 29 14:35:32.988616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 1/2] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 14:35:32 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 379 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:35:32.998890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e6104a3-0f7c-4999-a9fe-dde5c2af320f tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Action: 'create', calling method: .version_select at 0x7f681205daf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1200911939", "metadata": {"Type": "work"}}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e6104a3-0f7c-4999-a9fe-dde5c2af320f tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 119 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:35:33.011168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1200911939", "metadata": {"Type": "work"}}} Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: Jul 29 14:35:33.012507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1200911939', 'metadata': {'Type': 'work'}}}} Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise error Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi '' Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:33.013300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 29 14:35:33.014580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 29 14:35:33.015678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 29 14:35:33.015678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.015678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e6104a3-0f7c-4999-a9fe-dde5c2af320f tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:33.015678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e6104a3-0f7c-4999-a9fe-dde5c2af320f tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020513 Jul 29 14:35:33.015678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 2/3] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 14:35:32 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:35:33.025781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-542d2dd4-1238-4e61-901b-450e28ac42ad tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Calling method '.version_select at 0x7f68121b7ee0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:33.101291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:33.103065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:33.104089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:33.109825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:35:33.762566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-542d2dd4-1238-4e61-901b-450e28ac42ad tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] HTTP exception thrown: Volume tempest-invalid-881127596 could not be found. Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-542d2dd4-1238-4e61-901b-450e28ac42ad tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-881127596 HTTP/1.1 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:35:33.766425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Volume tempest-invalid-881127596 could not be found. Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'tempest-invalid-881127596'} Jul 29 14:35:33.768444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-881127596 could not be found. (HTTP 404) (Request-ID: req-57ca0467-1edb-45ca-ae09-0898efc8504c) Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:33.769373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:35:34.196178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-881127596 could not be found. Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:35:34.198965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-881127596 could not be found. Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-881127596 could not be found. Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-542d2dd4-1238-4e61-901b-450e28ac42ad tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 404 to user: Volume tempest-invalid-881127596 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-542d2dd4-1238-4e61-901b-450e28ac42ad tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-881127596" status: 404 len: 98 microversion: 2.1 time: 0.746734 Jul 29 14:35:34.200485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1215 bytes} [Fri Jul 29 14:35:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-881127596 => generated 98 bytes in 749 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 29 14:35:34.201655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-24556f46-8821-4b0f-ab68-8d0e5dc9aa10 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004100 Jul 29 14:35:34.201655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 3/5] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Jul 29 14:35:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 14:35:34.202523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-65ad1305-84ae-4e7f-b3b9-c9999e7c494d tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004060 Jul 29 14:35:34.202523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 3/6] 10.222.0.49 () {58 vars in 1137 bytes} [Fri Jul 29 14:35:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 29 14:35:34.203016 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-62a6f57b-8a65-4ad8-a977-859eca1fdb60 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Calling method '.version_select at 0x7f681201cd30>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:34.866236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-62a6f57b-8a65-4ad8-a977-859eca1fdb60 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] HTTP exception thrown: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-62a6f57b-8a65-4ad8-a977-859eca1fdb60 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/os-volumes/4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d HTTP/1.1 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:35:34.871101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d'} Jul 29 14:35:34.872105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. (HTTP 404) (Request-ID: req-cb84c36d-7c1c-4ae3-9099-409b4059a7ba) Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.872694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:35:34.873750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 14:35:34.875333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-62a6f57b-8a65-4ad8-a977-859eca1fdb60 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 404 to user: Volume 4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-62a6f57b-8a65-4ad8-a977-859eca1fdb60 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d" status: 404 len: 109 microversion: 2.1 time: 1.075451 Jul 29 14:35:34.877773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:35:33 2022] DELETE /compute/v2.1/os-volumes/4dd5a99b-9d97-432b-81cc-6fc67dbf1e9d => generated 109 bytes in 1077 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:35:34.885250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-159710fd-7454-4808-8dfa-569b4bfa5634 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Calling method '.version_select at 0x7f6811f4ed30>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:34.921516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-159710fd-7454-4808-8dfa-569b4bfa5634 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] HTTP exception thrown: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-159710fd-7454-4808-8dfa-569b4bfa5634 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Request method failure captured: Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/os-volumes/b1c0d636-d189-4b14-a6b3-7f2b899300ac HTTP/1.1 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_AzvhEItATfvU-2V2wfEYkJrtZR41ZKevNkc-dRuLXib1n3NxHGiHMCJw7NmuyXzxAtex0QlOfn7Zkzi6WnaQeynz2JDu4bUHNCl1EDnxTArcQGM9hMtv62aTuyOpxhlgJwMX7WOp4Kszum7ciiTzPF-mViHK633h2TUVmNlwgwqO8 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:35:34.923604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/7d4c357515b04f71ba99c3f1cae80ddd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/7d4c357515b04f71ba99c3f1cae80ddd"}]}] Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 7d4c357515b04f71ba99c3f1cae80ddd Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesNegativeTest-768552823 Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: d28e4b47b1fb4f24bdbe2ef9c99a6b95 Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesNegativeTest-768552823-project Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'b1c0d636-d189-4b14-a6b3-7f2b899300ac'} Jul 29 14:35:34.925157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. (HTTP 404) (Request-ID: req-bb648d13-982b-4261-b209-12998e339681) Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.926053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:35:34.927122 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 14:35:34.930040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-159710fd-7454-4808-8dfa-569b4bfa5634 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] Returning 404 to user: Volume b1c0d636-d189-4b14-a6b3-7f2b899300ac could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:35:34.932534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-159710fd-7454-4808-8dfa-569b4bfa5634 tempest-VolumesNegativeTest-768552823 tempest-VolumesNegativeTest-768552823-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/b1c0d636-d189-4b14-a6b3-7f2b899300ac" status: 404 len: 109 microversion: 2.1 time: 0.044011 Jul 29 14:35:34.935328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:35:34 2022] GET /compute/v2.1/os-volumes/b1c0d636-d189-4b14-a6b3-7f2b899300ac => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:35:41.924257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-774706ff-9f2c-42bd-8f24-db57c16a9af7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: .version_select at 0x7f6811f55820>, body: {"keypair": {"name": "tempest-keypair-1972198051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOe3vGMRpxrHTfcQndmMGBG7WSlkHMgjmXpJ1TuyYatRHX4gIDC6nogQHirWFD420052RsqLGiBp4KLi8SWwtqtqV/HhHul6UZ+cr/O/2ShDqyjhvwYLKgGuoW9zsdUWpg=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:42.047516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-774706ff-9f2c-42bd-8f24-db57c16a9af7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:42.066206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-774706ff-9f2c-42bd-8f24-db57c16a9af7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for user de769d721b8b49c6a5d7d391412da122 and project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:42.267916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-774706ff-9f2c-42bd-8f24-db57c16a9af7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.845422 Jul 29 14:35:42.267916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 5/9] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Jul 29 14:35:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 847 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 14:35:46.249984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-aa388881-4a2a-47c3-b23c-970b3d790c9a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: .version_select at 0x7f6811f4ed30>, body: {"keypair": {"name": "tempest-keypair-1999437859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPw9X7s2Psc6EPIIpzVFg0fZ1GIOauyGaEFIX2lFJ0Vq7WaX2Hv+SMZfzT6dzMlUQKN4F9w2xYI5xvb74ji1PqXnVsRkv31cykDV5EPrZyjqqA+80vf1fM8Kc5YciCG2EQ=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:46.402393 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-aa388881-4a2a-47c3-b23c-970b3d790c9a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:46.425278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-aa388881-4a2a-47c3-b23c-970b3d790c9a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:46.686331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-aa388881-4a2a-47c3-b23c-970b3d790c9a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.676942 Jul 29 14:35:46.693777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 5/10] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:35:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:35:48.686099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-92878382", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:48.879044 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] validate_networks() for [('490a78c0-d227-4aa8-8200-48bd37fbf557', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:35:50.935434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:35:50.935434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:35:50.935434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:35:50.935434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:35:50.935434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:35:50.948209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:50.948209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:50.948209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:50.948209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:50.965523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:50.965523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for user f4ae3fb6a7954a24b88df4f35f55020c and project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:50.965523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:35:50.967256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:35:51.000438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4e494971-e345-4d9a-b888-91dc23fa12a6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.448404 Jul 29 14:35:51.005508 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 6/11] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:35:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 2454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:35:51.021150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e2dd719b-289e-4dac-a8ce-4f804b47e7ef tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:51.021926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e2dd719b-289e-4dac-a8ce-4f804b47e7ef tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:51.321859 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e2dd719b-289e-4dac-a8ce-4f804b47e7ef tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:51.362503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e2dd719b-289e-4dac-a8ce-4f804b47e7ef tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1220 microversion: 2.1 time: 0.348943 Jul 29 14:35:51.383434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:51 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1220 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:51.498443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1731406816", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:51.659310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] validate_networks() for [('490a78c0-d227-4aa8-8200-48bd37fbf557', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:35:52.405677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-311645362", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3321aef9-3db9-44ad-a3ca-b4fe8a59d185"}], "security_groups": [{"name": "tempest-securitygroup--2102978559"}], "key_name": "tempest-keypair-1972198051", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:52.786597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] validate_networks() for [('3321aef9-3db9-44ad-a3ca-b4fe8a59d185', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:35:54.311705 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:35:54.314455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:35:54.314455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:35:54.314455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:35:54.314455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:35:54.367576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:54.368368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:54.375958 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:54.385253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:54.452902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:54.481097 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for user f4ae3fb6a7954a24b88df4f35f55020c and project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:54.505866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:35:54.508854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:35:54.509895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:35:54.510472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:35:54.511082 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:35:54.524422 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:54.525295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:54.529936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:54.529936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:54.530864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:35:54.533541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:35:54.564662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:54.565281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for user de769d721b8b49c6a5d7d391412da122 and project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:54.579527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:35:54.594977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:35:54.710888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-02a79008-89ce-4203-aeb4-784c23a92a59 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.217679 Jul 29 14:35:54.726742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 7/13] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:35:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 3234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:35:54.903152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad31eea6-8d9a-4248-84d1-d153873e80ad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.501155 Jul 29 14:35:54.904389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 7/14] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Jul 29 14:35:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2506 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 14:35:54.928081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c0f17f01-cf57-4e92-8600-d92e63c3aaec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:54.928711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c0f17f01-cf57-4e92-8600-d92e63c3aaec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:54.994709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8d0c236-3858-4c91-8960-e0dfa0a198a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: .version_select at 0x7f681162bca0>, body: {"keypair": {"name": "tempest-keypair-1798779586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIlIEmkkmNDixZtOy/amp2l8ObN6bVcAM7L3yPIn+MjeJTsS8DNHaey+WRNhZMKVeRvf6bpFU0tHCvblBzC+93383Ca0E5kKZtVk/bKIiHcdVZZbNgKT9lk6FQFrD349A=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:55.074844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a8d0c236-3858-4c91-8960-e0dfa0a198a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:55.096047 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a8d0c236-3858-4c91-8960-e0dfa0a198a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for user f3a38dc21bc34164aea48065da64823f and project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:55.291079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c0f17f01-cf57-4e92-8600-d92e63c3aaec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:55.303758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c0f17f01-cf57-4e92-8600-d92e63c3aaec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1222 microversion: 2.1 time: 0.392283 Jul 29 14:35:55.303758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 8/15] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:54 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1222 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:55.339332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8d0c236-3858-4c91-8960-e0dfa0a198a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.596770 Jul 29 14:35:55.339332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 8/16] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:35:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:35:55.346904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:55.360375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:55.407002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-487399691", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "networks": [{"uuid": "6291ac1e-b6e3-4761-a0dc-71100e0e382d"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:55.494962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] validate_networks() for [('6291ac1e-b6e3-4761-a0dc-71100e0e382d', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:35:55.625591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:55.636608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:55.638585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:55.646389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8c66de3e-e9b0-4eb2-b018-c19364f70ea6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1281 microversion: 2.20 time: 0.317264 Jul 29 14:35:55.653416 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 9/17] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:35:55 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1281 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:35:56.328301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0f19d950-de9f-4f74-a3ee-08574c25e619 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:56.329389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0f19d950-de9f-4f74-a3ee-08574c25e619 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:56.472059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0f19d950-de9f-4f74-a3ee-08574c25e619 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:56.486817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0f19d950-de9f-4f74-a3ee-08574c25e619 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1222 microversion: 2.1 time: 0.162522 Jul 29 14:35:56.488037 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 10/18] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:56 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1222 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:56.647127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:35:56.647802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:35:56.650009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:35:56.652530 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:35:56.653003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:35:56.684577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:56.684577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:56.701112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:56.701789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:56.703269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:56.704166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:56.762508 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Getting quotas for project 930127f777e34dd1911ed0443282d41a. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:56.772727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Getting quotas for user f489c80ce3324b818096ede43b690fb4 and project 930127f777e34dd1911ed0443282d41a. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:56.822076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:35:56.825053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:35:56.858578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:56.870917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:56.877507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:56.878655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cfd86bf4-490c-424f-978b-86306cab46c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1281 microversion: 2.20 time: 0.205348 Jul 29 14:35:56.894951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 11/19] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:35:56 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1281 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:35:56.908489 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-741659122", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b59a034-1f9b-4894-a9bb-b8f2d507494e"}], "security_groups": [{"name": "tempest-securitygroup--525626688"}], "key_name": "tempest-keypair-1999437859", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:35:57.010492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0254de18-29f9-46c1-9b36-6ec1c634d8b8 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.681031 Jul 29 14:35:57.011727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 9/20] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:35:57.025350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6243902d-187b-40f3-a337-552167bd994d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:57.026280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6243902d-187b-40f3-a337-552167bd994d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:57.095001 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] validate_networks() for [('5b59a034-1f9b-4894-a9bb-b8f2d507494e', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:35:57.237147 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6243902d-187b-40f3-a337-552167bd994d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:57.276317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6243902d-187b-40f3-a337-552167bd994d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1214 microversion: 2.1 time: 0.256289 Jul 29 14:35:57.276921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 10/21] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:57 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1214 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:35:57.509674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:57.510290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:57.525563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:57.526018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:57.526796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:57.527226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:57.748388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:35:57.752158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:35:57.752158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:35:57.752158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:35:57.752158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:35:57.763666 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:57.764324 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:57.765504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:57.767264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:57.825797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:35:57.835002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:35:57.860978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:35:57.865396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:35:58.094452 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ed10ecd4-80fe-47c4-8af7-fb7a83bc92ab tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.194737 Jul 29 14:35:58.095143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 12/22] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:35:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:35:58.106543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:58.107175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:58.134336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:58.135316 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:58.136180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:58.141697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:58.446885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.486956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.505827 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.505827 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1f79e738-3636-4c90-bbd9-f732b8ea0f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1285 microversion: 2.20 time: 0.400330 Jul 29 14:35:58.505827 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 13/23] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:35:58 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1285 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:35:58.512364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-eba07eac-4453-4816-b198-e025425fa892 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:58.513242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-eba07eac-4453-4816-b198-e025425fa892 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:58.593691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-eba07eac-4453-4816-b198-e025425fa892 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.606464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-eba07eac-4453-4816-b198-e025425fa892 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1241 microversion: 2.1 time: 0.106491 Jul 29 14:35:58.625484 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 14/24] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:58 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:58.631525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:58.632308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:58.643314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:58.644527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:58.647076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:58.647795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:58.705081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.728739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e832f8ea-5949-496a-9804-b56a6bc7de3e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1226 microversion: 2.1 time: 1.223009 Jul 29 14:35:58.740895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 11/25] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:57 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1226 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:58.812518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:58.825729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0f437a82-04e2-4238-801d-8ab6f54b9a88 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1218 microversion: 2.1 time: 0.198180 Jul 29 14:35:58.827132 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 15/26] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:58 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1218 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:35:59.524493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:59.525262 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:59.551686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.553629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:59.559984 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.568341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:59.627052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-920cb0a9-98c0-4e9c-9350-42f29ce4205b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:59.631145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-920cb0a9-98c0-4e9c-9350-42f29ce4205b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:59.766643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-920cb0a9-98c0-4e9c-9350-42f29ce4205b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:59.773903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-920cb0a9-98c0-4e9c-9350-42f29ce4205b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1241 microversion: 2.1 time: 0.151268 Jul 29 14:35:59.779724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 16/27] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:59 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:35:59.790212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:59.791700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:59.809692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.813219 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:59.816288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.819056 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:59.836857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:59.846378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:59.855250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:35:59.855250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-af2db482-2b2b-4c58-a110-a2f3dd958f1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1285 microversion: 2.20 time: 0.338486 Jul 29 14:35:59.857983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 12/28] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:35:59 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1285 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:35:59.862495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:35:59.864326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:35:59.902106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.902598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:35:59.904871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:35:59.905416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:00.113596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:00.126018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5bf56d7e-5ede-47ca-89b4-86d3cb7ef5c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1226 microversion: 2.1 time: 0.344481 Jul 29 14:36:00.127228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 17/29] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:59 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1226 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:00.133653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1726608032", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8907ae4f-3672-490c-8621-c3c212e0a603"}], "security_groups": [{"name": "tempest-securitygroup--1150956424"}], "key_name": "tempest-keypair-1798779586", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:00.333492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] validate_networks() for [('8907ae4f-3672-490c-8621-c3c212e0a603', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:36:00.416250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:00.438145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3c13a67d-91be-4e24-9788-d9d948c92926 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1210 microversion: 2.1 time: 0.578326 Jul 29 14:36:00.439433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 13/30] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:35:59 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1210 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:00.802816 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:00.812181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:00.839745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:00.843773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:00.850403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:00.850403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:00.968834 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:00.976825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-48748cfe-d1ec-419c-87fd-296e1c869cd3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1245 microversion: 2.1 time: 0.182003 Jul 29 14:36:00.977543 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 14/31] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:00 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1245 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:00.982662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:00.988658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:00.990735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:00.991135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:00.991948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:00.992388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:00.994773 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:36:00.995944 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:36:00.996622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:36:00.997258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:36:00.997864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:36:01.007990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.008668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.009875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.010738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.030690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:36:01.035917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for user f3a38dc21bc34164aea48065da64823f and project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:36:01.048900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:36:01.052175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:36:01.094144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:01.101513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.110165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.111751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.112916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-21a8aa98-3898-4b1c-bbf2-133e70a1f3c3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1333 microversion: 2.20 time: 0.134214 Jul 29 14:36:01.115456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 15/32] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:00 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1333 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:01.147756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:01.148375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:01.155150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.156151 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.157809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.159258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.216107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3df5b5af-d353-4d27-b03f-66d9ebdd4fb9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.087599 Jul 29 14:36:01.216764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 18/33] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:36:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:36:01.228704 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f103b628-43c4-447e-82be-b06f14cd2b56 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:01.229758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f103b628-43c4-447e-82be-b06f14cd2b56 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:01.244886 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.253728 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dea11425-b3db-4067-99a1-f3e097b23ef4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1274 microversion: 2.1 time: 0.110415 Jul 29 14:36:01.256043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 16/34] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:01 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:01.307216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f103b628-43c4-447e-82be-b06f14cd2b56 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.319769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f103b628-43c4-447e-82be-b06f14cd2b56 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1238 microversion: 2.1 time: 0.090307 Jul 29 14:36:01.326243 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 19/35] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:01 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1238 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:01.466735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:01.467490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:01.476653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.477169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.478110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:01.480714 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:01.551655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:01.563717 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c66603b6-4b4b-4b34-9a3c-26b457329bd5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1274 microversion: 2.1 time: 0.101278 Jul 29 14:36:01.564376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 17/36] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:01 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1274 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:02.006562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:02.007190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:02.026149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.026624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.027437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.027885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.142285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:02.142927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:02.170407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.170935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.171781 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.177828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.259108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.270614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2e9f5b97-5a35-4cd3-9848-126eaacb0e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1237 microversion: 2.1 time: 0.267903 Jul 29 14:36:02.271446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 20/37] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:02 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1237 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:02.284612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:02.288112 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:02.302479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.303254 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.304960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.306868 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.567606 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.577278 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.579091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.580688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d26a48e2-5eee-444b-acca-1a271c4ea9e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1341 microversion: 2.20 time: 0.447012 Jul 29 14:36:02.593722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 18/38] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:02 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1341 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:02.602864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f39a3af-2dcc-4be8-868c-2880cd723a9e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:02.604090 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8f39a3af-2dcc-4be8-868c-2880cd723a9e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:02.637187 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.653063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-de5a7fff-4686-4140-a75f-96fbff904fec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1282 microversion: 2.1 time: 0.380183 Jul 29 14:36:02.653690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 21/39] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:02 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1282 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:02.682638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:02.682946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f39a3af-2dcc-4be8-868c-2880cd723a9e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.683655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:02.691076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8f39a3af-2dcc-4be8-868c-2880cd723a9e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1238 microversion: 2.1 time: 0.095928 Jul 29 14:36:02.693276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.693922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.694060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 19/40] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:02 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1238 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:02.695058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:02.695670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:02.911769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:02.941442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9c6351c5-6b94-4f9d-8c4b-66abbb129e61 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1272 microversion: 2.1 time: 0.286603 Jul 29 14:36:02.949960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 22/41] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:02 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1272 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:03.292616 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:03.293339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:03.314081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.314536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.315329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.315773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.578929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:03.587679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f9086f4-cdb6-48c6-bd08-de06fa780f8b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1301 microversion: 2.1 time: 0.297981 Jul 29 14:36:03.601345 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 20/42] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:03 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1301 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:03.609076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:03.621340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:03.638164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.638548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.639360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.639926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.678015 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:03.678667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:03.700532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:03.705617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.710721 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.712800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.714832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.853302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:03.861027 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7c2c311a-fdb7-4487-b2d6-68d9f519359f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1280 microversion: 2.1 time: 0.189333 Jul 29 14:36:03.861612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 21/43] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:03 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1280 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:03.869747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:03.870365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:03.887754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:03.917550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:03.923723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.923723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.923723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.923723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:03.924071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:03.925521 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1584a5da-a56f-4be7-ab0f-d796eafbbacf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1339 microversion: 2.20 time: 0.322918 Jul 29 14:36:03.929662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:03 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:36:03.983472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:03.983875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:03.997417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:03.998085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.000930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.002272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.155712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:04.178823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-61e32a6c-85cf-48b4-a544-9e12176a9d63 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1290 microversion: 2.1 time: 0.312576 Jul 29 14:36:04.179432 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 22/45] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:03 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1290 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:04.259296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:04.272962 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ce19dfd7-cc8b-433b-8514-db417746ca96 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1272 microversion: 2.1 time: 0.292679 Jul 29 14:36:04.291098 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 24/46] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:03 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1272 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:04.609045 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:04.609823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:04.619050 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.621486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.626755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.627640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.800970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:04.810264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b21ea4ea-2d45-4f83-b093-268871247a45 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1299 microversion: 2.1 time: 0.206008 Jul 29 14:36:04.827398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 23/47] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:04 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:04.884826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:04.886167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:04.900420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.902324 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.919346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.924511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.962225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:04.963304 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:04.981963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.986053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:04.992011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:04.992476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.247364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:05.247364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4737d818-c78c-4f90-83a1-49e586ba5f78 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1280 microversion: 2.1 time: 0.345156 Jul 29 14:36:05.247364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 25/48] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:04 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1280 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:05.247364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:05.247909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:05.253806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:05.262563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.262563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.264550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.265047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.276348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:05.283412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:05.285175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-920c817c-e9ec-4afb-a07b-421a1ea327e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1339 microversion: 2.20 time: 0.329077 Jul 29 14:36:05.309211 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:04 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1339 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:05.336084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:05.336084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:05.363622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.370768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.371624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.379508 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.543369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:05.554945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-901d0a6f-6d07-448e-a9f1-6f05dfe8c698 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1298 microversion: 2.1 time: 0.328872 Jul 29 14:36:05.615759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 26/50] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:05 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1298 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:05.855585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:05.857669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:05.898656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.902323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:05.904760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:05.907851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.229171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.239944 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9a0bd23a-91de-453a-8a70-1c5f0767f574 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1299 microversion: 2.1 time: 0.402857 Jul 29 14:36:06.246589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 27/51] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:05 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1299 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:06.256036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:06.256639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:06.275280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.275827 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.276703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.277221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.656214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.677303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3d0bfff5-7b04-4b05-9099-3ccbfdc6bae4 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 1.356175 Jul 29 14:36:06.679018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 25/52] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:05 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:06.690075 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:06.702729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:06.702928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.710918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a1ce8197-aea7-48db-85be-00213514e445 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1280 microversion: 2.1 time: 0.457993 Jul 29 14:36:06.715551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 28/53] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:06 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1280 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:06.721300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:06.724872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:06.726722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.734563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.734563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.734563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.735760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:06.751009 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.751792 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.752809 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:06.756044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:06.912087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.924330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.929760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.947626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-01d9f643-ad40-4b44-806a-6b44c9354a90 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1339 microversion: 2.20 time: 0.265091 Jul 29 14:36:06.953327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 26/54] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:06 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1339 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:06.955400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:06.972791 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cb0bf928-e95d-4e41-8ed4-07b23d294345 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1296 microversion: 2.1 time: 0.253712 Jul 29 14:36:06.977478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 29/55] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:06 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1296 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:07.288131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:07.288893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:07.307586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.309749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:07.312350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.312880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:07.422252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:07.556175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:07.565849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-592fa164-fa42-4527-80be-8b7f0bdc22b6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1299 microversion: 2.1 time: 0.281893 Jul 29 14:36:07.577169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 27/56] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:07 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1299 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:07.712793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:07.719714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:07.733457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:07.735444 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:07.777223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.786684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.787378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:07.788448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.789714 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:07.789948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:07.790887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:07.798945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:08.638347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:08.652984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-209ef705-f6a7-4b09-b4dd-27e9a8837282 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.950353 Jul 29 14:36:08.654311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 30/57] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:07 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:08.671189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:08.672738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:08.694614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:08.698485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:08.700214 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:08.702828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:09.311887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:09.322705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:09.330305 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:09.344141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7a6ef0e9-3e7a-49ef-a23d-ac92f1f5994a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.683858 Jul 29 14:36:09.344141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 31/58] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:08 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:09.345857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:09.346688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:09.363784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:09.364760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:09.365824 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:09.366457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:09.405875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:09.508501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:09.540064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-19c04960-2aa0-4de2-ad66-d34ccc0abcc9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 1.808650 Jul 29 14:36:09.545815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 28/59] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:07 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:09.576731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:09.576731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:09.596179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:09.615232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:09.615232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:09.615232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:10.458134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:10.459815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-128be91e-4d56-4ce0-9103-0d7f9903cba3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.912541 Jul 29 14:36:10.468452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 29/60] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:09 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:10.483624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:10.484869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:10.495888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:10.496659 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:10.497819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:10.505148 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:10.680860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:10.688910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9d5e2d77-f552-4659-99ea-dbb5bfd3849b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 1.347132 Jul 29 14:36:10.691637 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 32/61] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:09 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:10.708533 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:10.709478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:10.724016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:10.728298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:10.732055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:10.732166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.020456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=6 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:11.209328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:11.223083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:11.229049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:11.235702 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f2f99b9a-42c0-4e28-acff-fc2cd3203f44 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.540850 Jul 29 14:36:11.240208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 33/62] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:10 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:11.253900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:11.257189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:11.278012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.279946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.282571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.283264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.313131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=38 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:11.370888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:11.387991 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-04554369-54a4-429c-afc9-32fce860164d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.918004 Jul 29 14:36:11.390503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 30/63] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:10 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:11.504023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:11.505255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:11.516610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.518355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.518355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.518828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.537291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:11.571178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4ddf6089-6166-44dd-baee-b995b8177ba8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.327771 Jul 29 14:36:11.572390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 34/64] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:11 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:11.723920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:11.724862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:11.735958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.736733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:11.746207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:11.746999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.343943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:12.359145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bd32d42a-60b9-492c-804f-9d81ca0b8c30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.864717 Jul 29 14:36:12.375492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 31/65] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:11 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:12.625348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-7ede96cd-ea43-4040-b581-0c0980994eb9 req-d184cb83-a9a2-4cd7-a950-9825380bf2f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc46760-6ced-4861-8ee4-00e8d662c0ab", "tag": "fd703da7-6ac9-4944-b5ef-7aa82be533b6"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:12.653627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7ede96cd-ea43-4040-b581-0c0980994eb9 req-d184cb83-a9a2-4cd7-a950-9825380bf2f1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.658918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7ede96cd-ea43-4040-b581-0c0980994eb9 req-d184cb83-a9a2-4cd7-a950-9825380bf2f1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.710764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=30 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:12.746619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-7ede96cd-ea43-4040-b581-0c0980994eb9 req-d184cb83-a9a2-4cd7-a950-9825380bf2f1 service nova] Creating event network-changed:fd703da7-6ac9-4944-b5ef-7aa82be533b6 for instance edc46760-6ced-4861-8ee4-00e8d662c0ab on hv-cinder-79987 Jul 29 14:36:12.747166 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-7ede96cd-ea43-4040-b581-0c0980994eb9 req-d184cb83-a9a2-4cd7-a950-9825380bf2f1 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 14:36:12.748319 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.748863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.749859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.750469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.772555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.compute.rpcapi [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 14:36:12.774537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] Releasing lock "compute-rpcapi-router" {{(pid=124771) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 14:36:12.811713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f86326df-4cf9-4652-9f76-8100a9798cc5 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.434766 Jul 29 14:36:12.813465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 32/66] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:12.821938 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:12.831055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cb65825c-5427-41a9-b10c-3111c501530b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 1.111184 Jul 29 14:36:12.844147 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:12.844482 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 35/67] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:11 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:12.844670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:12.844670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.844842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.846017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.846212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.846670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:12.851021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:12.866563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.867155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:12.868048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:12.868592 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:13.809519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:13.811494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:13.811494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e44f7a7d-2555-46e8-90f6-9e808c967873 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.954754 Jul 29 14:36:13.811494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 36/68] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:12 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:13.811838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:13.811838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:13.811838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-26947e38-2059-4071-a644-b6357fe67b68 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.981524 Jul 29 14:36:13.812168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 33/69] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:12 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:13.821602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:13.821602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:13.823722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:13.823722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:13.837076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:13.838260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:13.838741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:13.839204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:13.840063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:13.840415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:13.840539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:13.841148 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:14.602490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:14.616414 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b7589063-640f-4a1f-bfc0-ae4e22a7ce51 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.815004 Jul 29 14:36:14.622942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 37/70] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:13 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:14.799261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-7d050076-af40-4c7a-be8d-65294ea94e88 req-10032bf0-5763-433d-809a-9414b0a73714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d246d85-a191-4e2c-9a66-7b47ad26b961", "tag": "9af32531-28ae-4aa3-a87a-402e00f06507"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:14.856579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7d050076-af40-4c7a-be8d-65294ea94e88 req-10032bf0-5763-433d-809a-9414b0a73714 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:14.878126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7d050076-af40-4c7a-be8d-65294ea94e88 req-10032bf0-5763-433d-809a-9414b0a73714 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:14.946017 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-7d050076-af40-4c7a-be8d-65294ea94e88 req-10032bf0-5763-433d-809a-9414b0a73714 service nova] Creating event network-changed:9af32531-28ae-4aa3-a87a-402e00f06507 for instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 on hv-cinder-79987 Jul 29 14:36:14.952888 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7d050076-af40-4c7a-be8d-65294ea94e88 req-10032bf0-5763-433d-809a-9414b0a73714 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 29 14:36:14.956084 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:14.960335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:14.961631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:14.962228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:14.981949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.compute.rpcapi [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 29 14:36:14.983087 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] Releasing lock "compute-rpcapi-router" {{(pid=124772) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 29 14:36:15.019539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-51bd8202-0f5e-48d4-8ab6-462d55b23016 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389174 Jul 29 14:36:15.019539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 38/71] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:15.022868 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:15.025288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:15.040815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.041849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.045406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.053490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.053490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.076325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3a7e41ca-02ca-4246-a437-ccddb52db858 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 1.269569 Jul 29 14:36:15.085219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 34/72] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:13 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:15.102178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:15.103593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:15.118161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.125231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.125231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.125231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.353147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.361374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8ad1714b-6a83-498a-ac27-b4d7cd03c19f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.343097 Jul 29 14:36:15.362643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 39/73] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:15 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:15.368622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:15.369498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:15.378086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.378739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.379852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.380959 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.784012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.796115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.797675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.798806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-126c4c8a-47d8-43a7-864c-8509bdd320d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.433989 Jul 29 14:36:15.802202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 40/74] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:15 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:15.813670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}, {"name": "network-changed", "server_uuid": "6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae", "tag": "abe28195-9569-4a0d-a8af-38b76a84cda8"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:15.825910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.826540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.839418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:15.843329 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] Creating event network-changed:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:36:15.844042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] Creating event network-changed:abe28195-9569-4a0d-a8af-38b76a84cda8 for instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae on hv-cinder-79987 Jul 29 14:36:15.851767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-d5083699-3561-42e1-bfd4-e28706d2a4e0 req-b497ce92-0ad4-47dc-b9e6-219005e05e4b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047845 Jul 29 14:36:15.853934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 41/75] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:15.854621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1c90a720-bccd-4d51-abae-7b9484185a98 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.767946 Jul 29 14:36:15.855198 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 35/76] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:15 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:15.860653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:15.866862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:15.873205 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.874012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:15.875153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:15.875743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.108176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:16.110249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:16.146224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.146699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.151917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.152412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.661018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:16.663847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c53f4735-50fd-460b-86a3-54f3a14494eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.808322 Jul 29 14:36:16.664642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 42/77] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:15 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:16.679112 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:16.679741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:16.690823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.709239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.711127 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.712005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.960810 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:16.972373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2df82317-4b01-4cb6-8314-36ce246b5437 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.875560 Jul 29 14:36:16.973776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 36/78] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:16 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:16.978998 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:16.979922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:16.986775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.987630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:16.989236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:16.989893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.456178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:17.469224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c456ef67-30a9-492f-bd04-d37c444b8e9c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.802877 Jul 29 14:36:17.470738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 43/79] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:16 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:17.480530 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:17.482899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:17.499026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:17.499873 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.502042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:17.503511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.796151 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:17.808486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8b0ffcbd-b5af-4a6c-a765-3725ed3e3677 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.336485 Jul 29 14:36:17.824160 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 44/80] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:17 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:17.833649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "540afb78-5835-4fc1-9779-59c54f993946", "tag": "a72200fd-5afd-4bce-a98e-052d04bbd88e"}, {"name": "network-changed", "server_uuid": "3bd0a632-5ab1-4f92-8793-e25143d73dac", "tag": "a7f344b9-d58e-4eb7-b77e-49116544a3bb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:17.845244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:17.845986 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.866167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] Creating event network-changed:a72200fd-5afd-4bce-a98e-052d04bbd88e for instance 540afb78-5835-4fc1-9779-59c54f993946 on hv-cinder-79987 Jul 29 14:36:17.866690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] Creating event network-changed:a7f344b9-d58e-4eb7-b77e-49116544a3bb for instance 3bd0a632-5ab1-4f92-8793-e25143d73dac on hv-cinder-79987 Jul 29 14:36:17.873917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-cf377e6d-c3c5-4404-8179-6a12e6f2c24c req-e434cca3-c798-46b0-8cf4-debff2b3521c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048233 Jul 29 14:36:17.884102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 45/81] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:17.884102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:17.884102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:17.885470 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:17.888344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:17.889063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.889613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:17.890240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:17.895665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:17.897526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:17.901471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-887cbaaa-0593-4650-b630-073921377331 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.923646 Jul 29 14:36:17.901471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 37/82] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:16 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:17.999001 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:17.999896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:18.010008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.010477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.013254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.014095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.172770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:18.180953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-76f85bee-2601-4f36-a428-1269184e0c28 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.305317 Jul 29 14:36:18.181563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 46/83] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:17 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:18.330978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:18.339184 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ca37df75-4491-47fa-b6bf-43c44abadae4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.344622 Jul 29 14:36:18.339963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 38/84] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:17 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:18.496272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:18.496272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:18.502797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.503390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.505178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.505694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.645448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:18.653457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0327c354-600f-4ef6-9bce-352f74965fdb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.165639 Jul 29 14:36:18.654328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 47/85] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:18 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:18.831792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:18.832455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:18.839055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.839507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.840446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.840922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.929636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:18.930344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:18.938574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.938574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.938805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:18.939475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:18.989264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:18.996379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-60c817fb-d152-47dd-9b29-c52edf19c488 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.168511 Jul 29 14:36:19.010341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 39/86] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:18 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:19.092434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:19.102017 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:19.103560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:19.104684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-09066c8c-787d-429e-a89b-c70320a42a45 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.182711 Jul 29 14:36:19.105288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 48/87] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:18 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:19.201577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:19.202597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:19.210646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.211105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.212061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.212490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.359838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:19.363886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:19.366557 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.367007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.367803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.368242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.378529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:19.387054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8fea95d6-9130-4242-aa52-24b86c0a6ced tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.188915 Jul 29 14:36:19.403929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 40/88] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:19 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:19.508392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:19.516615 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4e691d3a-b8ca-4ced-bad2-d6f55cc9c4d1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.160484 Jul 29 14:36:19.518891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 49/89] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:19 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:19.673709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:19.674320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:19.680456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.680914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.681788 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:19.682235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:19.982397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.000595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9fdedbde-7f8e-4814-b640-af9798531f4e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.330154 Jul 29 14:36:20.002959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 41/90] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:19 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:20.022499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:20.023409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:20.039061 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.039518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.043346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.046429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.137464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:20.137464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:20.147037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.147789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.149391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.149847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.331798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.335893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:20.344025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-dc31f5ec-4de1-4858-9919-b55fefc91b74 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.326651 Jul 29 14:36:20.344874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 50/91] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:20 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:20.369308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.378542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.380583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.381730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6e30cadf-c46a-4959-be37-e94f1739c171 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.255923 Jul 29 14:36:20.382288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 42/92] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:20 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:20.414522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:20.415279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:20.421403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.421846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.422615 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.423049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.538981 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:20.539606 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:20.549288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.549288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.549288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:20.549288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:20.598478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.606149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-41dd48b9-7b32-439c-b699-2d891a627051 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.196166 Jul 29 14:36:20.606715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 51/93] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:20 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:20.753314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:20.761193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-89a9f294-0b20-487b-811f-e2f101e8d0c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.226056 Jul 29 14:36:20.762049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 43/94] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:20 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:21.022980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:21.023649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:21.029913 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.030367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.031134 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.031570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.177127 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.185409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5cf1a431-460c-4571-aa19-c31004b712fc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.166659 Jul 29 14:36:21.185980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 52/95] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:21 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:21.365702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:21.366310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:21.372594 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.373083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.373989 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.374352 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.396806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:21.404859 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:21.409779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:21.412322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.413090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.413878 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.414484 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.551671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.560111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.561686 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.563156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9bcf0d6b-b4bb-4871-8426-e9d2cfb5cce2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.161855 Jul 29 14:36:21.563741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 53/96] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:21 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:21.614084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.623216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eeb1ac52-81da-4f28-8419-d75e70ba6634 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.261381 Jul 29 14:36:21.627145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:21.628328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:21.635215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.635667 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.636476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.637073 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.638837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 44/97] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:21 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:21.782121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:21.782121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:21.789440 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.789958 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.790871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:21.791377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:21.820820 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:21.834008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c7e10111-61c2-47fd-b728-760beb7ff1ec tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.210577 Jul 29 14:36:21.845030 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 54/98] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:21 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:21.995404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.003088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eddd53db-9420-422b-a74b-037d5c0cb0a2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.226007 Jul 29 14:36:22.004010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 45/99] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:21 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:22.207229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:22.208332 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:22.217906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.218355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.219133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.219570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.373315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.380955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f6eb3a8c-ae2c-4a28-be85-aaa3f0021311 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.177830 Jul 29 14:36:22.381548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 55/100] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:22 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:22.586640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:22.588109 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:22.593516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.593965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.594739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.595182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.643963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:22.644587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:22.651307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.651764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.652553 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.653228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.768736 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.776706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:22.780591 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.783434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.785155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-efebc4a9-dcfb-4ab0-9633-43575b60f91d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.202845 Jul 29 14:36:22.797625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 46/101] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:22 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:22.846914 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:22.856259 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5f4da7d1-306d-4aef-87f5-10b34ea83be3 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.216286 Jul 29 14:36:22.857028 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 56/102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:22 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:22.863501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:22.863501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:22.874725 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.875877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:22.877733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:22.878299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.024636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:23.025520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:23.037544 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.039178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.041653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:23.042312 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.047307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.050787 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b1e758ff-bee7-4d3c-af30-e35a78bd50af tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.197854 Jul 29 14:36:23.052373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 47/103] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:22 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:23.198104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:23.205615 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cb1451f2-7639-4a2f-853c-3214af2221b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.185464 Jul 29 14:36:23.206172 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 57/104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:23 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:23.401899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:23.402703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:23.411312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.411956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.412936 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.413740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.568473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:23.578450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cc5665f3-4d76-4ef7-8a35-c13c190d5cdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.180246 Jul 29 14:36:23.579277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 48/105] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:23 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:23.808714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:23.809356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:23.815372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.815825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.816651 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.817408 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.882817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:23.883431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:23.891178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.891844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.892795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:23.893422 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:23.990986 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:23.999759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.010157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.010157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a29b0545-b7c6-40f1-be1c-f69462adf4ca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.198069 Jul 29 14:36:24.010157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 58/106] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:23 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:24.050103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.058495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3dd96d88-5a85-4830-bc3c-e89b7c514a1d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.179747 Jul 29 14:36:24.059072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 49/107] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:23 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:24.076941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:24.077892 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:24.085454 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.085980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.086828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.087387 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.229494 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:24.230221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:24.237776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.238458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.239541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.240165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.264451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.272480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5f589b99-ab6e-4840-9add-70d31cfb1b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.199728 Jul 29 14:36:24.273068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 59/108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:24 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:24.374197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.382187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-78647bbf-3a97-456a-8747-7e5d2cca65b4 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.158831 Jul 29 14:36:24.382828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 50/109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:24 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:24.599825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:24.600443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:24.607393 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.607846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.609677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:24.609677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:24.758985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:24.766706 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2314176c-58ed-455b-a403-07147f726da4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.170841 Jul 29 14:36:24.767282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 60/110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:24 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:25.026205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:25.026825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:25.033037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.033493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.034274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.034708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.078900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:25.079515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:25.081423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:25.087152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.087610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.088385 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.088825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.177451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.187726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.189589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.190695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ac848e9b-a197-4db4-b97e-d85974f2f000 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.168510 Jul 29 14:36:25.191406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 51/111] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:25 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:25.228816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.236646 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d4cd7cf1-528a-4af4-8a14-a8a2db965d38 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.161501 Jul 29 14:36:25.237540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 61/112] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:25 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:25.294805 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:25.295314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:25.302618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.303070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.303853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.304303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.404155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:25.404774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:25.411317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.411771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.412559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.413014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.462225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.469854 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e9520eea-f5c1-4e2a-905c-145978af1499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.179179 Jul 29 14:36:25.482335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 52/113] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:25 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:25.562950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.571062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3ee9d777-da10-4621-a97b-337f1ef0c025 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.171094 Jul 29 14:36:25.571850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 62/114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:25 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:25.791645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:25.792645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:25.800705 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.801344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.802333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:25.802865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:25.966317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:25.974501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-108bad7c-7f17-431a-bb6a-e7bfc98f3881 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.189470 Jul 29 14:36:25.975400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 53/115] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:25 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:26.214156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:26.214759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:26.221700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.222358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.223385 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.223979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.259934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:26.261194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:26.268439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.269244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.271053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.271508 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.430128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.443923 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.449090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.450696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-63b13884-d2d5-4f87-82cc-376468c42195 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.240592 Jul 29 14:36:26.453555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 63/116] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:26 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:36:26.462958 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.472698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f054c999-c5f8-461f-bf8f-4a9631c028f1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.218038 Jul 29 14:36:26.476397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 54/117] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:26 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:26.495192 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:26.495951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:26.507758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.507758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.507758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.508222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.593386 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:26.594329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:26.600754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.601293 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.602080 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.602912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.664068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.671523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5749a59d-a327-46ed-9fe8-97b078bc540d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.183654 Jul 29 14:36:26.672077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 64/118] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:26 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:26.744247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-25f6dc90-ac8a-4b86-8ebd-c7663acdb5af req-81f06591-392b-4e60-9bf3-f2f4b37f459a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d246d85-a191-4e2c-9a66-7b47ad26b961", "name": "network-vif-plugged", "status": "completed", "tag": "9af32531-28ae-4aa3-a87a-402e00f06507"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:26.756929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:26.758672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-25f6dc90-ac8a-4b86-8ebd-c7663acdb5af req-81f06591-392b-4e60-9bf3-f2f4b37f459a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:26.759396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-25f6dc90-ac8a-4b86-8ebd-c7663acdb5af req-81f06591-392b-4e60-9bf3-f2f4b37f459a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:26.765862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f98ffe6-dd84-4fdd-acbd-8a0f0512c4b2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.176178 Jul 29 14:36:26.766440 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 55/119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:26 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:26.774050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-25f6dc90-ac8a-4b86-8ebd-c7663acdb5af req-81f06591-392b-4e60-9bf3-f2f4b37f459a service nova] Creating event network-vif-plugged:9af32531-28ae-4aa3-a87a-402e00f06507 for instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 on hv-cinder-79987 Jul 29 14:36:26.781582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-25f6dc90-ac8a-4b86-8ebd-c7663acdb5af req-81f06591-392b-4e60-9bf3-f2f4b37f459a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108183 Jul 29 14:36:26.782312 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 65/120] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:26.995782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:26.996399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:27.002377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.002829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.005380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.005380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.142181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.147614 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a9a5a689-9fec-4dfd-a788-39a72049dc77 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.155576 Jul 29 14:36:27.148284 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 56/121] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:26 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:27.479450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:27.480309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:27.488311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.488311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.490800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.490800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.496233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:27.496879 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:27.503017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.503530 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.510006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.510006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.631704 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.639984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.641509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.642674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-fc102e02-1fa1-4aac-a552-e4b36b780376 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.167635 Jul 29 14:36:27.643218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 66/122] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:27 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:27.693456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:27.699403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:27.700725 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:27.702425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.702872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.703808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.704245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.714622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.725661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f381c5ef-5d26-4f50-8a08-4e37cfbf6078 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.233360 Jul 29 14:36:27.734004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 57/123] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:27 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:27.787510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:27.788231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:27.794688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.795250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.796398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:27.796836 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:27.850959 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.858458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a3da370d-906e-48f1-a2eb-6f6f2675b9ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.169905 Jul 29 14:36:27.859019 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 67/124] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:27 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:27.959835 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:27.968259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bdac5eb1-bd6e-4055-927a-4c57997f85cc tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.185560 Jul 29 14:36:27.988398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 58/125] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:27 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:28.170922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:28.171534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:28.177374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.177835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.178612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.179049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.191371 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:28.312981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:28.321368 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6a1944ea-566e-48be-8527-b879067cfff1 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.154322 Jul 29 14:36:28.321921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 68/126] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:28 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:28.667321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:28.668078 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:28.675632 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.676092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.677488 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.677928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.747229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:28.747872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:28.753999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.754474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.755325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.755768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.818067 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:28.831532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:28.833323 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:28.834765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9a3b8901-f498-4dae-8d94-a22454a1a2e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.171480 Jul 29 14:36:28.835394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 59/127] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:28 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:28.879479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:28.880379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:28.886938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.887665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.889011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.889555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:28.890665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:28.899133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1454a118-7292-4237-9e2e-d05bb645f199 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.156035 Jul 29 14:36:28.900804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 69/128] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:28 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:28.989591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:28.990439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:28.999143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:28.999789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.000864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.001690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.073874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:29.095265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0f803fb0-cc59-47fc-9656-a8bd0bec46d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.219593 Jul 29 14:36:29.095987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 60/129] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:28 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:29.148161 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:29.157765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-714f28b6-6064-405f-b547-6b2e69795185 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.172534 Jul 29 14:36:29.158512 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 70/130] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:28 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:29.343386 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:29.343992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:29.353603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.353603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.353603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.353603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.356820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:29.485451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:29.493897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6f0f7230-ec14-402a-afa3-2c3a2030e645 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.153956 Jul 29 14:36:29.494334 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 61/131] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:29 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:29.865833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:29.865833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:29.865833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.865833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.867029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.867431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.922253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:29.922993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:29.933172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.933810 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:29.934667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:29.935255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.103628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.103628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.103933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.103933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-08b21e14-8310-4ef0-951d-be2ca4e454e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.185781 Jul 29 14:36:30.103933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 71/132] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:29 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:30.104286 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.104286 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7337e478-a96f-483f-a770-b4fe18f934ec tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.158396 Jul 29 14:36:30.104286 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 62/133] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:29 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:30.117276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:30.118069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:30.124954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.125609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.126604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.127327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.179590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:30.180412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:30.186785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.187234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.188002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.188439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.275620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.283222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-29e4d4e0-9d93-4126-9fe2-6d7f812037fb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.170243 Jul 29 14:36:30.283802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 72/134] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:30 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:30.331217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.340144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4cc4c14d-93b0-4414-9802-56cd68b8e94c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.164569 Jul 29 14:36:30.340795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 63/135] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:30 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:30.514390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:30.514999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:30.520920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.521400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.522168 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:30.522616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:30.649696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:30.657012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f6825154-027c-4312-8dc2-61bff16d3bd2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.146453 Jul 29 14:36:30.657594 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 73/136] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:30 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:31.062858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:31.064167 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:31.070760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.071429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.073105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.073924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.118587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:31.119921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:31.126228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.126672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.127443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.127879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.327178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.338174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.339988 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.341638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5df322d7-7f55-42d0-9c3d-ee5e370d8b7e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.282756 Jul 29 14:36:31.343802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 64/137] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:31 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:31.365502 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:31.368973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:31.376447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.377097 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.378076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.378696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.453688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.464804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-75e499c2-5647-41a5-b234-298c8298f16d tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.349982 Jul 29 14:36:31.465694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 74/138] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:31 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:31.471242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:31.472234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:31.481137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.486089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.486089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.486089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.540505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.550790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-99596473-0424-4255-bd89-b2f88537d0c7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.190687 Jul 29 14:36:31.552242 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 65/139] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:31 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:31.681883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:31.686140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:31.691926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:31.695370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-241cf9d1-83e8-47cb-b309-46ad3b671130 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.228240 Jul 29 14:36:31.696380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 75/140] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:31 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:31.702002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.702693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:31.703535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:31.704151 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.040966 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-9d45d4fd-2ced-47e7-bfdb-0282be4ab29d req-72416621-73e9-45f3-ada9-a72c3e7971c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540afb78-5835-4fc1-9779-59c54f993946", "name": "network-vif-plugged", "status": "completed", "tag": "a72200fd-5afd-4bce-a98e-052d04bbd88e"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:32.052237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-9d45d4fd-2ced-47e7-bfdb-0282be4ab29d req-72416621-73e9-45f3-ada9-a72c3e7971c0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.053672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-9d45d4fd-2ced-47e7-bfdb-0282be4ab29d req-72416621-73e9-45f3-ada9-a72c3e7971c0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.065971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-9d45d4fd-2ced-47e7-bfdb-0282be4ab29d req-72416621-73e9-45f3-ada9-a72c3e7971c0 service nova] Creating event network-vif-plugged:a72200fd-5afd-4bce-a98e-052d04bbd88e for instance 540afb78-5835-4fc1-9779-59c54f993946 on hv-cinder-79987 Jul 29 14:36:32.071147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-9d45d4fd-2ced-47e7-bfdb-0282be4ab29d req-72416621-73e9-45f3-ada9-a72c3e7971c0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036014 Jul 29 14:36:32.071945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 76/141] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:32.077111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.084970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-63ced3d2-d8a4-4977-b35a-5373d0b950d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.410740 Jul 29 14:36:32.086775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 66/142] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:31 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:32.366858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:32.367546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:32.374340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.374790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.375560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.375995 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.490466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:32.491207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:32.501636 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.502110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.502883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.503330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.529036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.539309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.541064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.542255 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f60dbe13-22f9-4bb4-a51a-a47b3fe8c502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.180390 Jul 29 14:36:32.545059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 77/143] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:32 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:32.573749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:32.577200 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:32.580783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.581268 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.582037 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.582467 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.726974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.735107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f6d78bf2-d195-4155-ad5b-5713e3591c19 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.166690 Jul 29 14:36:32.736095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 78/144] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:32 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:32.738156 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.743045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:32.744063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:32.751095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.755316 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.755468 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4b23f5dc-4264-445f-b1c6-f209d7a0f607 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.265714 Jul 29 14:36:32.755580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:32.755580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:32.755729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 67/145] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:32 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:32.906367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:32.914699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-11eefece-0915-4b03-ae0a-77be0ca4988c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.177415 Jul 29 14:36:32.915267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 79/146] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:32 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:33.106064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:33.106695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:33.114799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.115245 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.116022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.116455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.256650 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.263956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-60485a91-294c-499c-a79e-3473ea2657f8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.161754 Jul 29 14:36:33.264523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 68/147] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:33 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:33.566036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:33.566702 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:33.573384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.573908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.574684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.575116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.752979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.756635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:33.757404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:33.763400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.763867 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.764607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.765310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.788040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.789934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.791059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0e2e4c82-ba99-41d0-b1d2-f277ece2936d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.228855 Jul 29 14:36:33.791625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 80/148] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:33 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:33.796374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:33.799841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:33.813366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.813833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.814625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.815064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.899911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.907566 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-86b5735a-df72-45b3-b556-3877829f09d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.155173 Jul 29 14:36:33.908131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 69/149] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:33 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:33.935037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:33.935652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:33.944138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.944138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.944405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:33.944719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:33.981947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:33.993623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-75849719-5a1e-489a-aa26-a9f93d54d556 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.200485 Jul 29 14:36:34.019435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 81/150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:33 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:34.131592 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-a079490c-de82-4b9e-9b22-f41c9d80854b req-45b0332b-d207-44c4-bd51-7ec2ffbbefa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "name": "network-vif-plugged", "status": "completed", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:34.141405 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-a079490c-de82-4b9e-9b22-f41c9d80854b req-45b0332b-d207-44c4-bd51-7ec2ffbbefa3 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.144011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-a079490c-de82-4b9e-9b22-f41c9d80854b req-45b0332b-d207-44c4-bd51-7ec2ffbbefa3 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.154538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-a079490c-de82-4b9e-9b22-f41c9d80854b req-45b0332b-d207-44c4-bd51-7ec2ffbbefa3 service nova] Creating event network-vif-plugged:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:36:34.161167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-a079490c-de82-4b9e-9b22-f41c9d80854b req-45b0332b-d207-44c4-bd51-7ec2ffbbefa3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032220 Jul 29 14:36:34.162286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 82/151] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:34.285955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:34.286649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:34.288837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:34.294532 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.294975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.297988 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.298094 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-35ebdc16-abd2-49d0-8782-bf1711129ff7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.366174 Jul 29 14:36:34.298173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.298485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 70/152] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:33 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:34.459538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:34.462867 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d695dacb-c23c-4891-b680-b04985f1748d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.181363 Jul 29 14:36:34.477497 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 83/153] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:34 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:34.816294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:34.817341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:34.823578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:34.825367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.825966 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.826860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.827747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.929365 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:34.930616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:34.937456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.938066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.939005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:34.939496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:34.977438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:34.985484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:34.987095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:34.988285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3c69207c-c464-4b65-82bc-f0b7c4bcc56c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.177561 Jul 29 14:36:34.988947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 71/154] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:34 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:35.014349 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:35.015333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:35.022046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.022558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.023340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.023779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.076129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:35.084730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-755e1669-538e-48ff-adf7-3d63b4101dde tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.160591 Jul 29 14:36:35.085550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 84/155] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:34 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:35.166756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:35.174145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b84d5c0c-c372-4dc2-bcce-85a13011e6e6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.163832 Jul 29 14:36:35.174742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 72/156] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:35 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:35.318723 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:35.319349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:35.325412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.325855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.326890 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.329949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.487461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:35.488103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:35.495153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.495600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.496374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:35.496800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:35.545826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:35.572302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-dd3acbb5-a9c4-40b1-a29f-916078d41f0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.255416 Jul 29 14:36:35.573381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 85/157] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:35 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:35.647686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:35.655297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-04d9f2d7-3ed9-49f9-b49c-71955b197fdd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.172784 Jul 29 14:36:35.656247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 73/158] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:35 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:36.012219 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:36.012827 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:36.019157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.019598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.020638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.021166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.025904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:36.121479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:36.126002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:36.141765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.142219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.143015 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.143461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.199068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.226540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.228079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.229244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a2d09955-688f-49e4-bc46-255b717cbb96 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.221179 Jul 29 14:36:36.240103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 86/159] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:36 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:36.260541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:36.261488 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:36.268050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.268607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.269771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.271257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.412052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.420691 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-458b6f63-5251-47d0-acb6-7fef2d739499 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.307512 Jul 29 14:36:36.421306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 74/160] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:36 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:36.456688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.464861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8fa95fc5-ce90-4214-898c-cb853dc613fa tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.210503 Jul 29 14:36:36.465447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 87/161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:36 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:36.593594 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:36.594326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:36.600778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.601334 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.602112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.602545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.677985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:36.679117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:36.687452 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.689298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.692640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:36.693507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:36.767236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:36.778144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-38c35220-8ca2-4544-97f6-d87d979e9fb6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.187461 Jul 29 14:36:36.779179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 75/162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:36 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:37.091789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.101498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4176b601-f4f9-4d5b-b45f-f2c1348f03a8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.428425 Jul 29 14:36:37.105325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 88/163] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:36 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:37.266920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:37.267670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:37.277084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.277855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.279789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.280523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.441524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:37.442905 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:37.449411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.449970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.450815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.451533 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.490661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.506593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.508250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.510037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4777b106-7e9f-45c7-8293-2596ed5897b0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.247899 Jul 29 14:36:37.510854 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 76/164] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:37 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:37.517776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:37.518881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:37.531284 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.531821 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.533409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.533872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.600840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.611281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d1be7d4a-adf2-4452-984e-14f8b01f2438 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.173412 Jul 29 14:36:37.611857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 89/165] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:37 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:37.729474 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:37.732794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:37.737227 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f40c6c0-685a-4f4a-868a-09ecc8c88b20 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.225058 Jul 29 14:36:37.737987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 77/166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:37 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:37.802966 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:37.803577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:37.812443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.813150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.814238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:37.814871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:37.995719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:38.004921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5d628cfe-77ef-48e3-bc8d-23d7c41b69c6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.205274 Jul 29 14:36:38.005638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 90/167] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:37 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:38.123674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:38.124474 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:38.134529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.135118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.136148 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.136778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.324329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:38.334158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-35d93587-4f2e-4f16-bf1c-624bef9d13ac req-c2289c5d-e8c0-482f-b409-e077f1f62cce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae", "name": "network-vif-plugged", "status": "completed", "tag": "abe28195-9569-4a0d-a8af-38b76a84cda8"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:38.344035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-35d93587-4f2e-4f16-bf1c-624bef9d13ac req-c2289c5d-e8c0-482f-b409-e077f1f62cce service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.344327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e438dcaf-7c98-4069-a207-38b2c09c8f68 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.224179 Jul 29 14:36:38.344473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-35d93587-4f2e-4f16-bf1c-624bef9d13ac req-c2289c5d-e8c0-482f-b409-e077f1f62cce service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.357232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 78/168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:38 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:38.362565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-35d93587-4f2e-4f16-bf1c-624bef9d13ac req-c2289c5d-e8c0-482f-b409-e077f1f62cce service nova] Creating event network-vif-plugged:abe28195-9569-4a0d-a8af-38b76a84cda8 for instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae on hv-cinder-79987 Jul 29 14:36:38.378525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-35d93587-4f2e-4f16-bf1c-624bef9d13ac req-c2289c5d-e8c0-482f-b409-e077f1f62cce service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048459 Jul 29 14:36:38.380112 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 91/169] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:38.535124 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:38.536273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:38.557012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.558089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.559038 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.559769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.633429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:38.634162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:38.642371 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.643108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.644097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.644731 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.730495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:38.743383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:38.745061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:38.746399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a5f389dc-0916-4862-9c5c-5953239f02de tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.216762 Jul 29 14:36:38.747314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 79/170] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:38 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:38.760779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:38.761813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:38.770793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.771611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.772772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:38.773265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:38.999475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:39.013370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a98e9a4a-32b1-4959-9caa-4d2a2692e1f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.382562 Jul 29 14:36:39.016277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 92/171] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:38 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:39.030031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:39.030650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:39.039898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.040347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:39.041147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.041579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:39.096035 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:39.108294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-222f45a6-1272-4517-8884-00a3ee00f4a6 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.354145 Jul 29 14:36:39.112344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 80/172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:38 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:39.367326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:39.368055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:39.379196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.382214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:39.383865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.385282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:39.438395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:39.448824 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8c84826e-c4be-402b-b2ec-337cd8de88c8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.422862 Jul 29 14:36:39.451390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 93/173] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:39 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:39.575014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:39.584117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-80bbea52-f227-4c42-be83-ca07107a1b26 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.221531 Jul 29 14:36:39.593462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 81/174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:39 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:39.769760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:39.770406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:39.776377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.776833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:39.777749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:39.778187 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.039961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:40.041682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:40.050418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.052516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.053564 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.054209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.070669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.083795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.086057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.088106 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0d09bfb3-46ac-42c0-838f-ae288759000e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.322191 Jul 29 14:36:40.089471 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 94/175] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:39 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:40.134204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:40.134949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:40.141564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.142307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.143287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.143953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.308679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.340301 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-32fc26d8-bf5e-4b43-809e-4b051e81a48b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.295538 Jul 29 14:36:40.342756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 82/176] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:40 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:40.448978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.458400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1965bec7-ef33-4e8a-a0de-3c0420cc1976 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.327506 Jul 29 14:36:40.459070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 95/177] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:40 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:40.474376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:40.475183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:40.481403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.482317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.483441 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.484053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.604683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:40.605305 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:40.611716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.612333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.613261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.614382 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.732925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.744662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-495ebdf7-1677-4b0c-8492-15291a4d10c3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.276028 Jul 29 14:36:40.747150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 83/178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:40 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:40.770918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-ba9d25b3-e848-4d09-b7f3-c496ec9bd9d8 req-1522aef8-0f8a-4f84-b293-d1eddec66fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc46760-6ced-4861-8ee4-00e8d662c0ab", "name": "network-vif-plugged", "status": "completed", "tag": "fd703da7-6ac9-4944-b5ef-7aa82be533b6"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:40.788264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-ba9d25b3-e848-4d09-b7f3-c496ec9bd9d8 req-1522aef8-0f8a-4f84-b293-d1eddec66fab service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:40.789239 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-ba9d25b3-e848-4d09-b7f3-c496ec9bd9d8 req-1522aef8-0f8a-4f84-b293-d1eddec66fab service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:40.813518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:40.813704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-ba9d25b3-e848-4d09-b7f3-c496ec9bd9d8 req-1522aef8-0f8a-4f84-b293-d1eddec66fab service nova] Creating event network-vif-plugged:fd703da7-6ac9-4944-b5ef-7aa82be533b6 for instance edc46760-6ced-4861-8ee4-00e8d662c0ab on hv-cinder-79987 Jul 29 14:36:40.821859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-ba9d25b3-e848-4d09-b7f3-c496ec9bd9d8 req-1522aef8-0f8a-4f84-b293-d1eddec66fab service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059397 Jul 29 14:36:40.822450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 84/179] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:40.835601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-750fd760-27d0-42a5-972a-a6ff5c2f46b3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.234553 Jul 29 14:36:40.841800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 96/180] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:40 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:41.119662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:41.120347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:41.126627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.127068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.127823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.128255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.270843 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.282167 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.283790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.284952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f9c809a3-291b-4ad1-9ee2-7d69d3c0a3df tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.169561 Jul 29 14:36:41.290869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 85/181] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:41 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:41.367896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:41.368511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:41.374541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.375220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.376058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.376473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.482183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:41.483282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:41.493537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.508082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.508082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.508082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.529545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.539733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9ce9e519-1c6e-4374-bd46-c977a012d32b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.176301 Jul 29 14:36:41.540965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 97/182] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:41 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:41.671563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.680161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-35373ec7-cd84-4fb0-b4ee-9eec74e29e8a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1314 microversion: 2.1 time: 0.204075 Jul 29 14:36:41.680811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 86/183] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:41 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:41.772407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:41.773083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:41.779068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.779549 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.780309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.780790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.858534 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:41.859200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:41.865470 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.865925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.866906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:41.867368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:41.915956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:41.925384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-245ca8cc-a1dd-44de-8c5e-5121d864afaa tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.158012 Jul 29 14:36:41.934138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 98/184] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:41 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:42.001076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.012085 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1112ad7f-bf84-4432-9e06-ab3dd8e217b2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.157548 Jul 29 14:36:42.015907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 87/185] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:41 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:42.314167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:42.314975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:42.323449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.323901 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.325771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.326407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.476381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.484374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.485951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.487049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-433e74d1-2a48-4036-abf2-fc8b1cb76473 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.176667 Jul 29 14:36:42.487607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 99/186] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:42 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:42.561588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:42.573161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:42.573161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.573161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.573161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.573510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.702249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:42.703282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:42.711036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.711209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.711496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.712420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.712862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.719131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75d000ed-e1dc-4b8e-8715-918e51ae808c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.161576 Jul 29 14:36:42.720211 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 88/187] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:42 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:42.859784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:42.869838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-044b700c-27de-4519-aed8-39d9d300e257 req-8fdad8d8-b101-421a-89eb-176807a9377f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd0a632-5ab1-4f92-8793-e25143d73dac", "name": "network-vif-plugged", "status": "completed", "tag": "a7f344b9-d58e-4eb7-b77e-49116544a3bb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:42.879357 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-044b700c-27de-4519-aed8-39d9d300e257 req-8fdad8d8-b101-421a-89eb-176807a9377f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.880013 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-044b700c-27de-4519-aed8-39d9d300e257 req-8fdad8d8-b101-421a-89eb-176807a9377f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.885526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c4a4cf31-94c4-4339-a582-0e45197ad894 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1501 microversion: 2.1 time: 0.171756 Jul 29 14:36:42.886180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 100/188] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:42 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1501 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:42.891419 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-044b700c-27de-4519-aed8-39d9d300e257 req-8fdad8d8-b101-421a-89eb-176807a9377f service nova] Creating event network-vif-plugged:a7f344b9-d58e-4eb7-b77e-49116544a3bb for instance 3bd0a632-5ab1-4f92-8793-e25143d73dac on hv-cinder-79987 Jul 29 14:36:42.896568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-044b700c-27de-4519-aed8-39d9d300e257 req-8fdad8d8-b101-421a-89eb-176807a9377f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 Jul 29 14:36:42.897119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 89/189] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:42.949170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:42.949861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:42.959838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.961783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:42.965319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:42.965755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.034955 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:43.036320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:43.043703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.044529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.046064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.046523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.132345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.157017 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1e772084-baa8-4ae8-a226-64e25dece4f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.207571 Jul 29 14:36:43.157017 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 101/190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:42 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:43.214636 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.221719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4e0a9abc-2066-45b3-b729-769862727894 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.190925 Jul 29 14:36:43.222543 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 90/191] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:43 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:43.512838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:43.513540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:43.520534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.521069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.522143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.522585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.687303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.695990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.697744 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.700604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7a8e1b42-f181-49a2-b5c4-ddcf767fe23b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1407 microversion: 2.20 time: 0.191445 Jul 29 14:36:43.700604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 102/192] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:43 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:43.741340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:43.746202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:43.752418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.753188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.754767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:43.755325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:43.906320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:43.914531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d4045bfd-7788-4f75-a458-c3f715b46a73 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.178690 Jul 29 14:36:43.915099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 91/193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:43 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:44.180798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:44.181539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:44.187823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.188352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.189258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.189788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.207880 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:44.242870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:44.243532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:44.249847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.250303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.251089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.251531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.378706 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:44.386321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8d301d6b-5439-4f22-a23e-28d65f8ce1a5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1366 microversion: 2.1 time: 0.217011 Jul 29 14:36:44.386893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 103/194] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:44 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:44.418774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:44.426304 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b47197e8-1eef-4b03-8988-d272e4611c98 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.187342 Jul 29 14:36:44.426870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 92/195] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:44 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:44.723133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:44.723664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:44.730532 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.731003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.731798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.732234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.869300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:44.877334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:44.878974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:44.881269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3b0bcb6d-6f03-4e7e-993d-b6b962e3cfe1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1599 microversion: 2.20 time: 0.161291 Jul 29 14:36:44.881777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 104/196] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:36:44 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1599 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:36:44.904100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:44.905618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:44.910188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2181d4bf-ace3-4732-bfcb-d69584ef1af1"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:44.915978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:44.919339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.919957 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.924357 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.925061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.925849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.926287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:44.970656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:44.970656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.151727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-45104ca3-b247-4504-ba31-561e4c185efb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.251419 Jul 29 14:36:45.152442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 93/197] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Jul 29 14:36:44 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-interface => generated 284 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:36:45.158660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:45.160973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:45.167689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.168505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.169554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.170145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.333862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:45.343601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9b340bd5-0991-40a9-9b3e-b4b34e52a320 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.189687 Jul 29 14:36:45.359549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 94/198] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:45 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:45.407174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:45.407925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:45.415658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.416401 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.417473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.418114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.606627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:45.614872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-77a646e0-4684-4b96-b952-6f25131d0122 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1555 microversion: 2.1 time: 0.211024 Jul 29 14:36:45.615884 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 95/199] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:45 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1555 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:45.631134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:45.632271 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:45.642121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.647354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.648467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.648914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.659593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:45.829702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:45.837638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2e4917f4-ad3e-4a99-8d7b-a18787b2638a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.220616 Jul 29 14:36:45.838291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 96/200] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:45 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:45.842900 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:45.843371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:45.849961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.850466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.851247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:45.851688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:45.947878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-735f192c-d971-40b0-b9cb-135381d54f75 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108525 Jul 29 14:36:45.948467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 97/201] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:36:45 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:46.367264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:46.367938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:46.382481 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:46.383023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:46.384054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:46.384560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:46.706471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:46.715599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-edcbcb8d-8357-429c-899d-3713227c7fb6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.352478 Jul 29 14:36:46.716519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 98/202] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:46 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:46.861154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:46.861840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:46.877275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:46.878532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:46.879578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:46.880625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:47.444233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:47.455419 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e7bf6d12-623d-443c-9daf-fdc1aa08d1ae tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.599941 Jul 29 14:36:47.456559 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 99/203] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:46 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:47.462484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-701668e8-8bbc-4b78-a952-c8c5718260b9 req-b901df73-bda5-446f-a5f7-232885b50bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:47.473129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-701668e8-8bbc-4b78-a952-c8c5718260b9 req-b901df73-bda5-446f-a5f7-232885b50bf4 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:47.473574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-701668e8-8bbc-4b78-a952-c8c5718260b9 req-b901df73-bda5-446f-a5f7-232885b50bf4 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:47.486213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-701668e8-8bbc-4b78-a952-c8c5718260b9 req-b901df73-bda5-446f-a5f7-232885b50bf4 service nova] Creating event network-changed:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:36:47.492819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-701668e8-8bbc-4b78-a952-c8c5718260b9 req-b901df73-bda5-446f-a5f7-232885b50bf4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034760 Jul 29 14:36:47.493599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 100/204] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:36:47.737087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:47.738083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:47.746976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:47.747755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:47.748951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:47.749619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:47.820595 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-284cf0c7-cbaf-4483-a724-53a3081b79ff tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "POST /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.913635 Jul 29 14:36:47.823887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 105/205] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:36:44 2022] POST /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961/os-volume_attachments => generated 194 bytes in 2916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:47.979289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-904c9642-73bc-4e01-9dd7-7d7cfa139f1e req-fe15b479-c2b5-4c95-9871-2569534affd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae", "tag": "abe28195-9569-4a0d-a8af-38b76a84cda8"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:47.990948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-904c9642-73bc-4e01-9dd7-7d7cfa139f1e req-fe15b479-c2b5-4c95-9871-2569534affd2 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:47.991728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-904c9642-73bc-4e01-9dd7-7d7cfa139f1e req-fe15b479-c2b5-4c95-9871-2569534affd2 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:48.004144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-904c9642-73bc-4e01-9dd7-7d7cfa139f1e req-fe15b479-c2b5-4c95-9871-2569534affd2 service nova] Creating event network-changed:abe28195-9569-4a0d-a8af-38b76a84cda8 for instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae on hv-cinder-79987 Jul 29 14:36:48.010407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-904c9642-73bc-4e01-9dd7-7d7cfa139f1e req-fe15b479-c2b5-4c95-9871-2569534affd2 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036758 Jul 29 14:36:48.011560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 106/206] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:48.060157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:48.071493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f21bfc4-76de-435a-b3b0-cd8927d91480 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.338355 Jul 29 14:36:48.087264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 101/207] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:47 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:48.478211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:48.479176 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:48.492104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:48.495672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:48.495672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:48.495672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:48.738087 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:48.754556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-59b5237f-fe3d-46ce-ad19-06e99d5fd816 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.281166 Jul 29 14:36:48.756893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 107/208] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:48 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:49.099333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:49.100355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:49.107908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:49.108378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:49.109273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:49.109706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:49.255733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:49.264297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-480f4db1-cdd1-411e-9765-dcc1fc0a68ee tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1322 microversion: 2.1 time: 0.169755 Jul 29 14:36:49.269110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 102/209] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:49 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:49.778420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:49.779062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:49.785679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:49.786129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:49.787529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:49.788025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:49.924679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:49.932499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-41f3fedf-cbf1-4d9b-8d4c-f8e86bae5b57 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.157851 Jul 29 14:36:49.933369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 108/210] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:49 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:50.287511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:50.289135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:50.296165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.297131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:50.298186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.298748 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:50.679159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:50.686959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e8638773-6ab5-4610-b160-f513d3c2d35f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1517 microversion: 2.1 time: 0.405646 Jul 29 14:36:50.687530 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 103/211] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:50 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1517 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:50.710713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:50.712921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:50.719051 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.719663 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:50.720430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.720864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:50.743333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'flavor' on Instance uuid edc46760-6ced-4861-8ee4-00e8d662c0ab {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:36:50.954052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:50.954670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:50.961620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.962079 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:50.962857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:50.963296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:51.103465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a11420ae-8cbd-402a-b263-189d44ac72c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab/action" status: 200 len: 32 microversion: 2.1 time: 0.397887 Jul 29 14:36:51.104496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 109/212] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:36:50 2022] POST /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab/action => generated 32 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:36:51.109177 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:51.116184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:51.121018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:51.128299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6d083fdb-cdca-4486-b53c-78aa758dbb3c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1364 microversion: 2.1 time: 0.171828 Jul 29 14:36:51.128299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 104/213] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:50 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:51.143732 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:51.147212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:51.148312 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:51.148967 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:51.425517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:51.433318 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-650aefdc-08e1-4170-8499-9ec3afeb0bea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.322569 Jul 29 14:36:51.433923 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 110/214] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:51 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:52.147906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:52.148813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:52.157051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.160011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.163614 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.164253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.455491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:52.456111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:52.463357 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.463804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.464570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.465064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.611052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:52.625153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-265b0c36-f4b2-44ba-89cd-1c276105b3d0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.168555 Jul 29 14:36:52.625153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 111/215] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:52 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:52.630548 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:52.639155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-356106a0-dc31-46de-bc35-5e467a46c0db tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1550 microversion: 2.1 time: 0.495334 Jul 29 14:36:52.640228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 105/216] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:52 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1550 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:52.661262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:52.661858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:52.668104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.668633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.669502 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:52.670009 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:52.747906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a961ea5a-065a-40b7-a4a3-df936c097f5f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090826 Jul 29 14:36:52.748529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 112/217] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:36:52 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:53.641570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:53.642417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:53.649446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:53.650229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:53.651119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:53.651664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:53.828790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:53.836961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8605578-93c7-4283-8c54-3a9ac9cac3d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.199165 Jul 29 14:36:53.837597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 106/218] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:53 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:54.290852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-40857a71-8a30-4adf-8b76-5e9b6b06de2d req-469bf8fd-8721-484d-afc1-2556c934193e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd0a632-5ab1-4f92-8793-e25143d73dac", "tag": "a7f344b9-d58e-4eb7-b77e-49116544a3bb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:54.300462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-40857a71-8a30-4adf-8b76-5e9b6b06de2d req-469bf8fd-8721-484d-afc1-2556c934193e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:54.300910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-40857a71-8a30-4adf-8b76-5e9b6b06de2d req-469bf8fd-8721-484d-afc1-2556c934193e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:54.315989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-40857a71-8a30-4adf-8b76-5e9b6b06de2d req-469bf8fd-8721-484d-afc1-2556c934193e service nova] Creating event network-changed:a7f344b9-d58e-4eb7-b77e-49116544a3bb for instance 3bd0a632-5ab1-4f92-8793-e25143d73dac on hv-cinder-79987 Jul 29 14:36:54.320132 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-40857a71-8a30-4adf-8b76-5e9b6b06de2d req-469bf8fd-8721-484d-afc1-2556c934193e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034012 Jul 29 14:36:54.321054 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 113/219] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:36:54.859934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:54.861339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:54.868870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:54.871962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:54.872776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:54.873248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:55.179922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:55.189535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8f844a85-1634-4abd-b6ec-050287216c29 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.334176 Jul 29 14:36:55.205486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 107/220] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:54 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:56.212043 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:56.212745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:56.219026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:56.221656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:56.221656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:56.221656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:56.354936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:56.363609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-29ac8235-9741-4045-80c3-69be1a42b8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.156512 Jul 29 14:36:56.364231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 114/221] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:56 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:57.385619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:57.386264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:57.392837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:57.393399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:57.394277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:57.394809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:57.541332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:57.549228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dd0a8685-c721-4ff1-b160-ab0b67154c50 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.167564 Jul 29 14:36:57.549804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 108/222] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:57 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:57.842787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1800664439", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "networks": [{"uuid": "24d55193-271a-40ae-b6fa-f6888d8a660b"}]}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:36:57.897915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] validate_networks() for [('24d55193-271a-40ae-b6fa-f6888d8a660b', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:36:58.302858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:36:58.303382 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:36:58.303858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:36:58.304267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:36:58.304680 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:36:58.306850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=97 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:36:58.314846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:58.315321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:58.316139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:58.316656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:58.333789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Getting quotas for project a8ee55d2489d40f480f2fc2772712744. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:36:58.337612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Getting quotas for user 227203ab050f43f793d8c4fe3c31497d and project a8ee55d2489d40f480f2fc2772712744. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:36:58.348200 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:36:58.350546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:36:58.525790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9fda5a95-c62e-410b-b206-40fa404b3b58 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.686814 Jul 29 14:36:58.526439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 115/223] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:36:58.537159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3f0f335-5e16-4a8a-a053-6cd3bf21a646 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:58.537772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3f0f335-5e16-4a8a-a053-6cd3bf21a646 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:58.576415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:58.577047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:58.583886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:58.584487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:58.585431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:58.585879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:58.600010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3f0f335-5e16-4a8a-a053-6cd3bf21a646 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:58.608634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3f0f335-5e16-4a8a-a053-6cd3bf21a646 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1214 microversion: 2.1 time: 0.075350 Jul 29 14:36:58.609906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 109/224] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:58 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:58.727831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:58.738464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2c322aef-e6f3-4f47-bdea-3bea78d1be36 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.162770 Jul 29 14:36:58.738464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 116/225] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:58 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:36:59.629762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:59.630360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:59.636519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:59.636961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:59.637758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:59.638186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:59.697277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:59.704793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-36a2df6d-189d-4f9c-85bc-6029361effe3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1218 microversion: 2.1 time: 0.078857 Jul 29 14:36:59.705380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 110/226] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:59 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:36:59.756373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:36:59.757026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:36:59.763937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:59.764383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:59.765211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:36:59.765645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:36:59.901547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:36:59.908964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5ac7a67a-626d-410a-b707-e5a5da2d9e1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.156675 Jul 29 14:36:59.909728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 117/227] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:36:59 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:00.726838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:00.727449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:00.733527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:00.733971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:00.734738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:00.735168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:00.796091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:00.803464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-50fe80f5-a84a-4f62-ba03-b4edc0fe6064 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1218 microversion: 2.1 time: 0.081265 Jul 29 14:37:00.804022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 111/228] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:00 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:00.930608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:00.931250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:00.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:00.938452 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:00.939215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:00.939651 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:01.087713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:01.095643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2258b8bb-11ae-41a3-9dd1-ba7da6a8c2f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.169659 Jul 29 14:37:01.096202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 118/229] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:00 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:01.823963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:01.824486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:01.830463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:01.830901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:01.831652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:01.832079 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:01.893230 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:01.900775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-19211644-0160-4d5f-8b82-19e8db4c1e63 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1210 microversion: 2.1 time: 0.080696 Jul 29 14:37:01.901368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 112/230] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:01 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1210 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:02.123223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:02.124693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:02.140746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:02.140746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:02.140746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:02.140746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:02.145070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:02.281590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:02.290717 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e2709564-cf2e-4d2a-9174-0ce350137094 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.172675 Jul 29 14:37:02.291390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 119/231] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:02 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:02.921804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:02.922410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:02.929302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:02.929752 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:02.930516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:02.930950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:02.994694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:03.002199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1885358a-1681-4e9f-8537-061d811f74ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1266 microversion: 2.1 time: 0.084147 Jul 29 14:37:03.002906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 113/232] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:02 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:03.297450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:03.297978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:03.305878 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.306325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.307100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.307835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.313809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:03.314454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:03.321530 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.322101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.322987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.324503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.340251 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:37:03.653668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-45091db2-e8c9-4d99-857c-3348e9592107 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 204 len: 0 microversion: 2.1 time: 0.359641 Jul 29 14:37:03.654350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 120/233] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:37:03 2022] DELETE /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:37:03.664123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:03.665303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:03.671679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.672128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.677570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:03.677570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:03.754570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:03.762370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:03.765702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5fa86c36-feba-45ec-ac0a-31b85f1b26d9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.455963 Jul 29 14:37:03.766952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 114/234] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:03 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:03.832770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:03.841111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b8f602d8-fc9a-4b92-b6e9-d358342d3a9f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1553 microversion: 2.1 time: 0.181594 Jul 29 14:37:03.845267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 121/235] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:03 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1553 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:04.024373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:04.025008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:04.031332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.031773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.032538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.032969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.257108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:04.266938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6de19522-4762-4599-941e-60fc31ea39fe tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.247154 Jul 29 14:37:04.270571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 115/236] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:04 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:04.791346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:04.791951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:04.798566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.799011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.799858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.800281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.863927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:04.865098 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:04.872487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.872934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.873776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:04.874204 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:04.934560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:04.945476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-fc007556-dd2b-436e-ba92-f02856c801da tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.157830 Jul 29 14:37:04.946738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 122/237] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:04 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:05.009794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:05.018091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8ff95865-b302-4858-8061-c5ed9513fae5 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1553 microversion: 2.1 time: 0.158242 Jul 29 14:37:05.018778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 116/238] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:04 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:05.291930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:05.292540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:05.298518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:05.298953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:05.299744 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:05.300170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:05.433939 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:05.441499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7731158a-6519-4dc1-8f44-75cc476bc78d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.153424 Jul 29 14:37:05.442059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 123/239] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:05 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:05.967869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:05.968551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:05.970590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=93 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:05.975647 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:05.976216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:05.977251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:05.983187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.039984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:06.040598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:06.047239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:06.048009 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.048946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:06.049553 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.237378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:06.244845 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-43f599f2-ed12-4d62-aeea-ee8baaf342a8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.280877 Jul 29 14:37:06.245448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 117/240] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:05 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:06.463700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:06.464657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:06.478621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:06.479331 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.480127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:06.480558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.670493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:06.680052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-533c7ac1-dba3-4873-89aa-d7e8998ce869 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1553 microversion: 2.1 time: 0.643936 Jul 29 14:37:06.681091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 124/241] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:06 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1553 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:06.717733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:06.727492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-820ca54c-289e-4699-9286-76d7d7970c59 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.267759 Jul 29 14:37:06.729462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 118/242] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:06 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:06.894385 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-e5c2203a-d068-442f-b265-7e71a9f30e49 req-2b7885f6-641f-4942-ba47-985aabd1e8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32db5bb2-3bc9-4f14-89c1-fe266e8c1d84", "tag": "d081b637-b49a-426e-9789-f1d24871d6d3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:06.912501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e5c2203a-d068-442f-b265-7e71a9f30e49 req-2b7885f6-641f-4942-ba47-985aabd1e8e7 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:06.913307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e5c2203a-d068-442f-b265-7e71a9f30e49 req-2b7885f6-641f-4942-ba47-985aabd1e8e7 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:06.941607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-e5c2203a-d068-442f-b265-7e71a9f30e49 req-2b7885f6-641f-4942-ba47-985aabd1e8e7 service nova] Creating event network-changed:d081b637-b49a-426e-9789-f1d24871d6d3 for instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 on hv-cinder-79987 Jul 29 14:37:06.946997 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-e5c2203a-d068-442f-b265-7e71a9f30e49 req-2b7885f6-641f-4942-ba47-985aabd1e8e7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057297 Jul 29 14:37:06.948118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 125/243] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:37:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:07.266797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:07.267600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:07.274158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.274612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.275619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.276062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.704296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:07.705023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:07.713671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.714129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.714924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.715382 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.864162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:07.873114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2ff3c93e-0565-4032-b143-155e232ed4c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1553 microversion: 2.1 time: 0.173096 Jul 29 14:37:07.874640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 126/244] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:07 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1553 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:07.891481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:07.891986 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:07.894624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:07.899951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.904180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.904180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:07.904180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:07.904547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-61a7b06a-5b10-47f2-88ea-76fd49aff0c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.641469 Jul 29 14:37:07.905857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 119/245] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:07 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:08.071247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:08.078812 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0c51b01e-de17-4e12-b228-6a1519fd8910 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.192679 Jul 29 14:37:08.079384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 127/246] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:07 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:08.899340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:08.900696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:08.905961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:08.907574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:08.907932 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:08.909100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:08.909718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:08.926743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:08.929064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:08.932114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:08.932754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=6 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:08.937143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:08.937591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:08.938352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:08.938819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:08.998770 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:09.007888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bf2f0a68-5a75-4177-a436-1205f74ea004 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.113565 Jul 29 14:37:09.008458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 120/247] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:08 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:09.017953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6684920c-6720-4724-9d7a-1ab14e73bdb6 req-6580cf37-77b8-406d-9a5e-d511688e61df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d246d85-a191-4e2c-9a66-7b47ad26b961", "name": "network-vif-deleted", "tag": "9af32531-28ae-4aa3-a87a-402e00f06507"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:09.034733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6684920c-6720-4724-9d7a-1ab14e73bdb6 req-6580cf37-77b8-406d-9a5e-d511688e61df service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:09.034733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6684920c-6720-4724-9d7a-1ab14e73bdb6 req-6580cf37-77b8-406d-9a5e-d511688e61df service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:09.039664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6684920c-6720-4724-9d7a-1ab14e73bdb6 req-6580cf37-77b8-406d-9a5e-d511688e61df service nova] Creating event network-vif-deleted:9af32531-28ae-4aa3-a87a-402e00f06507 for instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 on hv-cinder-79987 Jul 29 14:37:09.044501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6684920c-6720-4724-9d7a-1ab14e73bdb6 req-6580cf37-77b8-406d-9a5e-d511688e61df service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030387 Jul 29 14:37:09.045303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 121/248] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:09.087882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:09.095320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-12a5deac-0d51-4e05-80ad-e80228e5e731 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.172348 Jul 29 14:37:09.096042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 128/249] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:08 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:09.100576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:09.103862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:09.107939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:09.108422 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:09.109217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:09.109685 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:09.244667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:09.252211 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0ff1628c-fead-4c8e-9694-a9efafc0e05d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.156839 Jul 29 14:37:09.252952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 122/250] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:09 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:10.027522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:10.028127 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:10.035935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.036090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.037433 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.037869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.100813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:10.108893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0ac043bb-866d-4f72-ad1e-4323b8d2e11f tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.085201 Jul 29 14:37:10.116155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 129/251] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:10 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:10.121083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:10.121698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:10.127608 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.128059 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.128826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.129289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.262392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:10.269990 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fab3fd56-0feb-4827-af73-efe6c3a27764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.152668 Jul 29 14:37:10.271410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 123/252] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:10 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:10.288779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:10.289461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:10.295670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.296272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.297077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:10.297547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:10.431740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:10.439783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-af2706df-c9a9-4fef-97b3-2ece0488d386 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.169939 Jul 29 14:37:10.440325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 130/253] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:10 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:11.129777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:11.130470 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:11.137132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.137583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.145313 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.145313 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.205765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:11.214297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0fb5a920-d6e2-414d-9473-1edc55ff6a82 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.088395 Jul 29 14:37:11.214869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 124/254] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:11 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:11.294301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:11.294915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:11.301837 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.302289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.303138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.303761 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.436190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:11.444889 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5e9299db-3a2e-439f-815c-0a6f173d126d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.154265 Jul 29 14:37:11.445551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 131/255] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:11 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:11.462016 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:11.462658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:11.471822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.471822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.471822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:11.471822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:11.605876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:11.614373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-33af075d-53cb-4a62-b255-30631fb774f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.157147 Jul 29 14:37:11.614935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 125/256] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:11 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:12.243912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:12.244533 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:12.250623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.251080 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.251849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.252279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.328053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:12.337184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0938e9f7-a3a1-498c-b0c6-0ca0f0b5c0c1 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.105254 Jul 29 14:37:12.337764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 132/257] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:12 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:12.466026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:12.466644 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:12.472902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.473387 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.474160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.474598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.608841 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:12.616926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef4846f3-f1b2-4344-9518-3b0b63a68650 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.154771 Jul 29 14:37:12.617592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 126/258] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:12 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:12.634992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:12.635599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:12.641826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.642271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.643029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:12.643588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:12.774335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:12.781610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-40d0c9bb-f9eb-4f0b-b834-365250c5571d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.150872 Jul 29 14:37:12.782171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 133/259] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:12 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:13.358410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:13.359176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:13.371926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.371926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.371926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.371926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.425512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:13.433835 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-646c4d23-a37d-4fd5-b8cd-b8553823b41a tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.079211 Jul 29 14:37:13.434400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 127/260] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:13 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:13.638579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:13.639109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:13.645652 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.646098 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.647627 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.648322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.778100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:13.781485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:13.785753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a5ead917-6b5c-4b78-b6c6-24c50b2bd45d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.151129 Jul 29 14:37:13.786314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 134/261] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:13 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:13.802945 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:13.803702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:13.810273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.810729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.811509 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:13.811956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:13.940398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:13.948477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f401227-d740-4559-a4aa-50e254b3480f tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.149507 Jul 29 14:37:13.949059 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 128/262] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:13 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:14.455341 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:14.455951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:14.462950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.463399 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:14.464164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.464599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:14.525223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:14.532851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c103b7c1-8df3-4323-9da7-fe70c1ca621b tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.081749 Jul 29 14:37:14.533450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 135/263] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:14 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:14.806964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:14.807578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:14.813819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.814264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:14.815030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.815464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:14.943144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:14.951391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-49d1dfcc-661b-4e06-893e-0b9fa55a9c01 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.149000 Jul 29 14:37:14.951942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 129/264] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:14 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:14.969254 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:14.969825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:14.976362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.976813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:14.977620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:14.978062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:15.108035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:15.115427 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-09b95bd3-4f9f-4c35-8e86-19aef63c965d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.150462 Jul 29 14:37:15.116673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 136/265] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:14 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:15.555055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:15.555715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:15.562291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:15.562735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:15.563497 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:15.563925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:15.623413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:15.631093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-baa35c59-88c4-404f-b5ee-564bded435d7 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.080484 Jul 29 14:37:15.631650 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 130/266] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:15 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:15.971666 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:15.972278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:15.979021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:15.979475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:15.980241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:15.980695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:16.108269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:16.115821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8ba878eb-33bb-4230-8c0c-5459f332eb86 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.148035 Jul 29 14:37:16.116390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 137/267] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:15 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:16.135732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:16.136337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:16.142373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:16.142999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:16.143767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:16.144195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:16.269758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:16.277515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f88cbf75-93ad-4717-b070-ce8ac4efb8d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.145822 Jul 29 14:37:16.278074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 131/268] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:16 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:16.651936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:16.652618 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:16.658703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:16.659152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:16.660014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:16.660461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:16.728154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:16.736601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2d31768e-55db-42dc-aca4-d0daf32bfa66 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1345 microversion: 2.1 time: 0.088750 Jul 29 14:37:16.737349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 138/269] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:16 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:17.138181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:17.138880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:17.144714 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.145258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.146035 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.146471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.150497 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:17.277258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:17.284861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-60205c1c-f02c-4f9d-afe8-e2910ccd6156 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.150657 Jul 29 14:37:17.285446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 132/270] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:17 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:17.298653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:17.299347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:17.306253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.306775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.307556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.307993 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.440208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:17.448002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4037976b-9a55-4efe-88f1-75781f1be540 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.153167 Jul 29 14:37:17.448553 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 139/271] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:17 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:17.759018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:17.759620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:17.765441 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.765882 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.766640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.767072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.797453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:17.797894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:17.798348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lazy-loading 'fault' on Instance uuid 7d246d85-a191-4e2c-9a66-7b47ad26b961 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:37:17.843690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f489c80ce3324b818096ede43b690fb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930127f777e34dd1911ed0443282d41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:17.850922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0d7f08eb-4303-4e46-8bca-4b6b756974e0 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 200 len: 1350 microversion: 2.1 time: 0.096808 Jul 29 14:37:17.852017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 133/272] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:17 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:18.173777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-52448f86-84e8-4bea-a5ab-d3e87a4a722c req-74112d9d-e7d2-4536-be81-62cceca4448e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32db5bb2-3bc9-4f14-89c1-fe266e8c1d84", "name": "network-vif-plugged", "status": "completed", "tag": "d081b637-b49a-426e-9789-f1d24871d6d3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:18.182157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-52448f86-84e8-4bea-a5ab-d3e87a4a722c req-74112d9d-e7d2-4536-be81-62cceca4448e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.182606 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-52448f86-84e8-4bea-a5ab-d3e87a4a722c req-74112d9d-e7d2-4536-be81-62cceca4448e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.195157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-52448f86-84e8-4bea-a5ab-d3e87a4a722c req-74112d9d-e7d2-4536-be81-62cceca4448e service nova] Creating event network-vif-plugged:d081b637-b49a-426e-9789-f1d24871d6d3 for instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 on hv-cinder-79987 Jul 29 14:37:18.200362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-52448f86-84e8-4bea-a5ab-d3e87a4a722c req-74112d9d-e7d2-4536-be81-62cceca4448e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032191 Jul 29 14:37:18.201007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 140/273] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:37:18.312145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:18.313669 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:18.322250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.322708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.323501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.323941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.468746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:18.469576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:18.477239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.480643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.480643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.480643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.487749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:18.498263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb5cbbba-dd05-405f-84a1-08b5192f5893 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.188355 Jul 29 14:37:18.509425 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 134/274] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:18 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:18.621950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:18.629972 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0b6f44df-fc37-45ac-8729-352301dc1d67 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.165523 Jul 29 14:37:18.630546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 141/275] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:18 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:18.877201 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:18.877812 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:18.885114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.885517 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.887418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:18.887855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:18.903565 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] HTTP exception thrown: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Request method failure captured: Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 HTTP/1.1 Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BKla_K0vPQ0HwWejXmR4ZwYtZq5Rw6uHcAQCqTVx812BIdwvt72UMhz6zAk9A1-s335yjUurYRBulzlWDarvIYPWJA9ryDIfOTo1ksa5EuULewy91qoLpyUjKghkPk0FCF_jY8jkabU4RzCAo9jEWrrr0FJQTQ9UNo8PbGhGDJnWw Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:37:18.909131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_930127f777e34dd1911ed0443282d41a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/930127f777e34dd1911ed0443282d41a"}]}] Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f489c80ce3324b818096ede43b690fb4 Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:18.910443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '7d246d85-a191-4e2c-9a66-7b47ad26b961'} Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:18.911283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:18.913244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:18.914457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Returning 404 to user: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:18.914457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3bf9151-7662-44f9-a907-037769a69b19 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 404 len: 111 microversion: 2.1 time: 0.037842 Jul 29 14:37:18.914457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 135/276] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:18 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:37:19.026817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:19.029088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:19.034976 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.035416 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.036179 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.036611 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.049210 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] HTTP exception thrown: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Request method failure captured: Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961/os-volume_attachments HTTP/1.1 Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BKla_K0vPQ0HwWejXmR4ZwYtZq5Rw6uHcAQCqTVx812BIdwvt72UMhz6zAk9A1-s335yjUurYRBulzlWDarvIYPWJA9ryDIfOTo1ksa5EuULewy91qoLpyUjKghkPk0FCF_jY8jkabU4RzCAo9jEWrrr0FJQTQ9UNo8PbGhGDJnWw Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:37:19.053202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_930127f777e34dd1911ed0443282d41a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/930127f777e34dd1911ed0443282d41a"}]}] Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f489c80ce3324b818096ede43b690fb4 Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:19.054582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'server_id': '7d246d85-a191-4e2c-9a66-7b47ad26b961'} Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:19.055407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:19.056770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:19.058449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Returning 404 to user: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:19.058449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e1b879b3-737d-4851-b373-6f8eb0897e57 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032868 Jul 29 14:37:19.058449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 142/277] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:37:19 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:37:19.517414 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:19.518031 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:19.524715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.525192 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.525961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.526397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.650660 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:19.651269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:19.655605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:19.657849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.658292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.659063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:19.659600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:19.663262 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f3a829b-3057-4ea0-a9fa-717e23645826 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.149750 Jul 29 14:37:19.663995 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 136/278] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:19 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:19.791182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:19.798589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2947aa05-9119-4f8a-931f-3b778fdaab6e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.152436 Jul 29 14:37:19.799154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 143/279] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:19 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:20.685223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:20.685749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:20.691950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:20.692400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:20.693193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:20.693694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:20.819711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:20.820449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:20.827825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:20.828277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:20.829078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:20.829591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:20.834865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:20.847665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-07efa4e4-f7df-4934-81dd-63c89b943f58 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.166807 Jul 29 14:37:20.865130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 137/280] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:20 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:20.965125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:20.972785 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-51663f64-415a-478c-ba9b-87015b9dc5a6 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1314 microversion: 2.1 time: 0.156808 Jul 29 14:37:20.973250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 144/281] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:20 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:21.486930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:21.487221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:21.493730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.494180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.494946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.495384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.509182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] HTTP exception thrown: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Request method failure captured: Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 HTTP/1.1 Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BKla_K0vPQ0HwWejXmR4ZwYtZq5Rw6uHcAQCqTVx812BIdwvt72UMhz6zAk9A1-s335yjUurYRBulzlWDarvIYPWJA9ryDIfOTo1ksa5EuULewy91qoLpyUjKghkPk0FCF_jY8jkabU4RzCAo9jEWrrr0FJQTQ9UNo8PbGhGDJnWw Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:37:21.510732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_930127f777e34dd1911ed0443282d41a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/930127f777e34dd1911ed0443282d41a"}]}] Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f489c80ce3324b818096ede43b690fb4 Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.512158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '7d246d85-a191-4e2c-9a66-7b47ad26b961'} Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:21.512938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.514157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.515222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Returning 404 to user: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:21.515222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1e0dcd89-2193-49be-b640-eae8e888b35e tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 404 len: 111 microversion: 2.1 time: 0.029263 Jul 29 14:37:21.515222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 138/282] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:37:21 2022] DELETE /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:37:21.520527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:21.521191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] [instance: 7d246d85-a191-4e2c-9a66-7b47ad26b961] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:21.527844 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.528289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.529150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.529598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.543256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] HTTP exception thrown: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Request method failure captured: Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 HTTP/1.1 Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BKla_K0vPQ0HwWejXmR4ZwYtZq5Rw6uHcAQCqTVx812BIdwvt72UMhz6zAk9A1-s335yjUurYRBulzlWDarvIYPWJA9ryDIfOTo1ksa5EuULewy91qoLpyUjKghkPk0FCF_jY8jkabU4RzCAo9jEWrrr0FJQTQ9UNo8PbGhGDJnWw Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:37:21.545517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_930127f777e34dd1911ed0443282d41a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/930127f777e34dd1911ed0443282d41a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/930127f777e34dd1911ed0443282d41a"}]}] Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 930127f777e34dd1911ed0443282d41a Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-DeleteServersTestJSON-1608537120 Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f489c80ce3324b818096ede43b690fb4 Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-DeleteServersTestJSON-1608537120-project Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.546930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '7d246d85-a191-4e2c-9a66-7b47ad26b961'} Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:21.547722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. Jul 29 14:37:21.549042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:21.550206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] Returning 404 to user: Instance 7d246d85-a191-4e2c-9a66-7b47ad26b961 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:21.550206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c113f708-632d-4da8-8d31-44c15ef4b796 tempest-DeleteServersTestJSON-1608537120 tempest-DeleteServersTestJSON-1608537120-project] 10.222.0.49 "GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961" status: 404 len: 111 microversion: 2.1 time: 0.030154 Jul 29 14:37:21.550206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 145/283] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:21 2022] GET /compute/v2.1/servers/7d246d85-a191-4e2c-9a66-7b47ad26b961 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:37:21.871673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:21.872395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:21.878318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.878768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.879546 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:21.879978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:21.993895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:21.994544 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:22.001154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:22.001542 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:22.002322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:22.002759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:22.098813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:22.107285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-29d486fe-f50e-441b-93e7-7fc5eb0a09f1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.239421 Jul 29 14:37:22.112276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 139/284] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:21 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:22.144885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:22.154133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9d0fce4b-5bfc-4e2b-8dc9-e219c3b88a48 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1498 microversion: 2.1 time: 0.164214 Jul 29 14:37:22.155015 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 146/285] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:21 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1498 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:23.128767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:23.129953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:23.140330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.140330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.140330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.140330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.327526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:23.328043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:23.332108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:23.335701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-34e3e411-ef41-4e69-8b03-7e5f3fae4894 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.210708 Jul 29 14:37:23.349042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 140/286] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:23 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:23.349320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.349841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.350698 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.351638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.378173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:37:23.677701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-22f32742-1bd9-43af-8399-d6e6566b0f7d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "DELETE /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 204 len: 0 microversion: 2.1 time: 0.351444 Jul 29 14:37:23.680984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 147/287] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:37:23 2022] DELETE /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 14:37:23.689758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:23.690374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:23.697063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.697804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.698603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:23.699044 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:23.943713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:23.954663 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-42e78036-2931-4532-a1c4-e1b683dd0f78 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1504 microversion: 2.1 time: 0.269068 Jul 29 14:37:23.969762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 141/288] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:23 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:24.357386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:24.358091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:24.364324 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:24.364775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:24.365777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:24.366029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:24.517027 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:24.525374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5af91696-3c1d-4dee-9e63-a4a567d40d99 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.172903 Jul 29 14:37:24.525947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 148/289] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:24 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:24.978056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:24.978670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:24.985355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:24.985811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:24.986580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:24.987018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:25.248306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:25.256087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bd18082e-5a78-482b-a4e1-a3d8c671a1ef tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1504 microversion: 2.1 time: 0.283250 Jul 29 14:37:25.257050 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 142/290] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:24 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1504 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:25.547365 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:25.548136 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:25.556308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:25.556936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:25.557857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:25.558636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:25.792943 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:25.800433 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-eaca3e07-b529-4532-b95b-26be679650c2 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.257854 Jul 29 14:37:25.801066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 149/291] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:25 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:26.286142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:26.286751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:26.294790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:26.295238 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:26.296227 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:26.296663 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:26.469572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:26.478927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-02c8ed40-a1ff-466f-bd18-a6af87e5e2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1504 microversion: 2.1 time: 0.197134 Jul 29 14:37:26.493694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 143/292] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:26 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1504 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:26.586361 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-4964444b-b76a-477b-972d-20fb53c53fd5 req-cdbe6b6b-992c-4f99-97e8-3af2e0d299e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32db5bb2-3bc9-4f14-89c1-fe266e8c1d84", "name": "network-vif-deleted", "tag": "d081b637-b49a-426e-9789-f1d24871d6d3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:26.597694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-4964444b-b76a-477b-972d-20fb53c53fd5 req-cdbe6b6b-992c-4f99-97e8-3af2e0d299e1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:26.598056 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-4964444b-b76a-477b-972d-20fb53c53fd5 req-cdbe6b6b-992c-4f99-97e8-3af2e0d299e1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:26.615220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-4964444b-b76a-477b-972d-20fb53c53fd5 req-cdbe6b6b-992c-4f99-97e8-3af2e0d299e1 service nova] Creating event network-vif-deleted:d081b637-b49a-426e-9789-f1d24871d6d3 for instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 on hv-cinder-79987 Jul 29 14:37:26.631047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-4964444b-b76a-477b-972d-20fb53c53fd5 req-cdbe6b6b-992c-4f99-97e8-3af2e0d299e1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048555 Jul 29 14:37:26.631654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 150/293] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:26.822188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:26.822833 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:26.833458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:26.833458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:26.833458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:26.833458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:26.972831 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:26.980458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e9ea7887-8d12-4a9b-94ea-33a27b9bd5c4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.162715 Jul 29 14:37:26.981063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 144/294] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:26 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:27.500731 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:27.502567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:27.508560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:27.509013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:27.509802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:27.510233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:27.542799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:27.543246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:27.543691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:37:27.590279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:27.598223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-74f3dc6c-bde3-45b4-a012-5eaf670e54d2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 200 len: 1304 microversion: 2.1 time: 0.101970 Jul 29 14:37:27.598786 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 151/295] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:27 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:28.003884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:28.004494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:28.006503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:28.014375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:28.014963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:28.015648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:28.016256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:28.020523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:28.085684 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e83b2b62-818d-4ed6-9770-818d10bbc09d tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Action: 'create', calling method: .version_select at 0x7f681033ca60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-128264189", "metadata": {"Type": "work"}}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:28.151566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:28.162047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-86b9f273-aaec-4aaa-856b-d222d6425fe1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.161997 Jul 29 14:37:28.162694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 152/296] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:27 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:28.625956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:28.626563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:28.634969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:28.635424 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:28.636196 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:28.636638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:28.650661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] HTTP exception thrown: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Request method failure captured: Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 HTTP/1.1 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_CGnx54JD5hSmaWhA0ZSI6MiX-v1BjZaKqEuiY53JFUzFGQiUXj9ydI-1wmsT6N-fCBL4_w8SlgeHq-j6ayn-TQyKK5xgsD74hQ_nN6tzFdu4kP481VSW-i87AGgecRc04VuQEfa28Y0E_7vY_WuIj6zjzX0KuHP7Om7hazU4VaFkY Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: a8ee55d2489d40f480f2fc2772712744 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesActionsTest-2060208933 Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:37:28.652325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ee55d2489d40f480f2fc2772712744"}]}] Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesActionsTest-2060208933 Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: a8ee55d2489d40f480f2fc2772712744 Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesActionsTest-2060208933 Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesActionsTest-2060208933-project Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 227203ab050f43f793d8c4fe3c31497d Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesActionsTest-2060208933-project Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. Jul 29 14:37:28.653831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '32db5bb2-3bc9-4f14-89c1-fe266e8c1d84'} Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:28.654835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. Jul 29 14:37:28.656541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:28.658220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Returning 404 to user: Instance 32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:28.658220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-64ed4e0b-8661-4c5c-81e8-5db6ececbff5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84" status: 404 len: 111 microversion: 2.1 time: 0.032146 Jul 29 14:37:28.658220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 153/297] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:28 2022] GET /compute/v2.1/servers/32db5bb2-3bc9-4f14-89c1-fe266e8c1d84 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:37:28.756421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-744605418", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "networks": [{"uuid": "24d55193-271a-40ae-b6fa-f6888d8a660b"}]}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:28.818659 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] validate_networks() for [('24d55193-271a-40ae-b6fa-f6888d8a660b', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:37:28.833207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e83b2b62-818d-4ed6-9770-818d10bbc09d tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.871557 Jul 29 14:37:28.833837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 145/298] 10.222.0.49 () {60 vars in 1156 bytes} [Fri Jul 29 14:37:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 873 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 14:37:28.846550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-912969ef-291a-4dad-a7ca-7fb0570ea884 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f68102da820>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:29.057263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-912969ef-291a-4dad-a7ca-7fb0570ea884 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 200 len: 352 microversion: 2.1 time: 0.214337 Jul 29 14:37:29.057829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 146/299] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:37:28 2022] GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:37:29.183838 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:29.184497 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:29.191353 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:29.191808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:29.192589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:29.193076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:29.222883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:37:29.223555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:37:29.225137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:37:29.225137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:37:29.225668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:37:29.236270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:29.236764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:29.237605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:29.238039 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:29.255259 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Getting quotas for project a8ee55d2489d40f480f2fc2772712744. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:37:29.260241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Getting quotas for user 227203ab050f43f793d8c4fe3c31497d and project a8ee55d2489d40f480f2fc2772712744. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:37:29.275350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:37:29.278093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:37:29.330503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:29.347391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ce07606-6c05-4cde-8955-ded36fcefc44 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.167684 Jul 29 14:37:29.353087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 147/300] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:29 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:29.386866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b5f63e90-d0e5-4cfc-a901-04bf0c4fb348 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634279 Jul 29 14:37:29.387481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 154/301] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:37:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 14:37:29.398275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e23041ac-d7be-4162-9f4d-96f403b6794e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:29.399026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e23041ac-d7be-4162-9f4d-96f403b6794e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:29.455553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e23041ac-d7be-4162-9f4d-96f403b6794e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:29.463401 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e23041ac-d7be-4162-9f4d-96f403b6794e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1213 microversion: 2.1 time: 0.069022 Jul 29 14:37:29.473700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 148/302] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:29 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:30.072070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-85474528-74d1-4adc-bd32-d0deb4665428 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f681054f4c0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.123613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-85474528-74d1-4adc-bd32-d0deb4665428 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 200 len: 353 microversion: 2.1 time: 0.056231 Jul 29 14:37:30.124183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 155/303] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:37:30 2022] GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:30.136343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-108eb6fc-b4d7-4a80-adfa-653e047fc1f6 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f681033c310>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.325630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-108eb6fc-b4d7-4a80-adfa-653e047fc1f6 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 200 len: 353 microversion: 2.1 time: 0.192884 Jul 29 14:37:30.327022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 149/304] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:37:30 2022] GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 353 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:30.345113 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-50856f73-364a-4598-83d6-a03505f4a718 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f6810249d30>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.373524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.374294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:30.383378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:30.384057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:30.385070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:30.385668 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:30.524737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:30.532371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6b8ffba9-ca8a-4232-8eaf-89cf794f6e0a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.163443 Jul 29 14:37:30.532927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 150/305] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:30 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:30.538358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.540112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:30.546433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:30.546943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:30.548046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:30.548490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:30.555370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-50856f73-364a-4598-83d6-a03505f4a718 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 202 len: 0 microversion: 2.1 time: 0.210374 Jul 29 14:37:30.555370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 156/306] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:37:30 2022] DELETE /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:37:30.569600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4c7588d3-dfce-4b20-b4b3-804750c703e3 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f681032a3a0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:30.620126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:30.628354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-21e6ac55-1637-405e-920a-0c995ce8cbf3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1209 microversion: 2.1 time: 0.092947 Jul 29 14:37:30.628944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 151/307] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:30 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:30.635558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4c7588d3-dfce-4b20-b4b3-804750c703e3 tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 200 len: 352 microversion: 2.1 time: 0.076689 Jul 29 14:37:30.636014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 157/308] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:37:30 2022] GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 352 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:37:31.554143 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:31.555395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:31.561897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:31.564091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:31.564091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:31.564091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:31.650065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-85f59d6e-894a-4f89-8fe9-b12919dcbe2e tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Calling method '.version_select at 0x7f6810246940>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:31.682712 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-85f59d6e-894a-4f89-8fe9-b12919dcbe2e tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] HTTP exception thrown: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-85f59d6e-894a-4f89-8fe9-b12919dcbe2e tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Request method failure captured: Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d HTTP/1.1 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_CntBjBHoJlZUndBl7Dsdc5-YfukqjEqB98WhJkTKh63jzOFIWyIYJeJf9nM702zclszTE0dEQ-IFbCqKs_er3dD6s58nIN4ErKRkleFZXgrlPsJyXgWD-tqdrl9tP1wBCfVauU45kklWTsYClVFv9dZZC29pN4dvijoD9XK_CvtyM Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 8b01ff17835d4bb4a4062552851fa8a3 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesGetTestJSON-528711689 Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:37:31.684941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_8b01ff17835d4bb4a4062552851fa8a3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b01ff17835d4bb4a4062552851fa8a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/8b01ff17835d4bb4a4062552851fa8a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/8b01ff17835d4bb4a4062552851fa8a3"}]}] Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesGetTestJSON-528711689 Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 8b01ff17835d4bb4a4062552851fa8a3 Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesGetTestJSON-528711689 Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesGetTestJSON-528711689-project Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f29a3aaf9e9d4f0393ec7f9a912f08a8 Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesGetTestJSON-528711689-project Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'ae4e0257-dfd3-422a-ac63-83ed2af33f4d'} Jul 29 14:37:31.686352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. (HTTP 404) (Request-ID: req-1bc3551e-1fb2-4878-8ef4-6add3ed9f626) Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:31.687269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:37:31.688375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 14:37:31.696225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-85f59d6e-894a-4f89-8fe9-b12919dcbe2e tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] Returning 404 to user: Volume ae4e0257-dfd3-422a-ac63-83ed2af33f4d could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-85f59d6e-894a-4f89-8fe9-b12919dcbe2e tempest-VolumesGetTestJSON-528711689 tempest-VolumesGetTestJSON-528711689-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d" status: 404 len: 109 microversion: 2.1 time: 0.041308 Jul 29 14:37:31.697751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 158/309] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:37:31 2022] GET /compute/v2.1/os-volumes/ae4e0257-dfd3-422a-ac63-83ed2af33f4d => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:37:31.698789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:31.698789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:31.702673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:31.703334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:31.704279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:31.704936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:31.790921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:31.812736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-11b8203e-32d5-4e6c-89cd-5efa09288dac tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1273 microversion: 2.1 time: 0.124757 Jul 29 14:37:31.819689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 159/310] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:31 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:31.863282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:31.871446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2036cfbd-ddc2-451b-9e02-00579b66a1e8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.321558 Jul 29 14:37:31.871956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 152/311] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:31 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:32.843804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:32.844467 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:32.851568 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:32.852029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:32.852819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:32.853291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:32.893712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:32.905421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:32.912134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:32.912768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:32.913605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:32.914046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:33.005889 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:33.017123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7304bc58-10ef-43b7-988a-018ec109c191 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.177118 Jul 29 14:37:33.017952 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 160/312] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:32 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:33.069552 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:33.074004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:33.080143 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f97ba28e-efc7-4d1f-a8fc-71d4af89a892 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.191988 Jul 29 14:37:33.091089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 153/313] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:32 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:34.039704 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:34.040314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:34.047631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:34.048081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:34.048846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:34.049308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:34.101761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:34.102391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:34.109597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:34.110051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:34.110836 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:34.111457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:34.226026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:34.235130 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7987424b-ca78-4112-82db-c68517b2a7d7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.199187 Jul 29 14:37:34.236293 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 161/314] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:34 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:34.287728 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:34.298086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-27bea3b2-12b5-419a-9ae3-c5b4366da672 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.200240 Jul 29 14:37:34.307505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 154/315] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:34 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:35.259844 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:35.260468 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:35.269212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:35.269683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:35.270466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:35.270898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:35.326131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:35.327006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:35.347010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:35.347458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:35.348238 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:35.348670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:35.427569 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:35.435873 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4b7935c1-e41f-4891-818f-b8cc75fc6bd4 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.182785 Jul 29 14:37:35.436435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 162/316] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:35 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:35.507671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:35.513911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-58409925-9727-471c-b42e-8c2b05c674d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.197715 Jul 29 14:37:35.514473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 155/317] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:35 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:35.548963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-6ff54445-d9a3-4025-8e21-d2f612c6eb49 req-8535030b-49a3-490a-8ac8-812129373a3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e353417-a829-48ae-b2c6-7f590bd74996", "tag": "a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:35.558769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-6ff54445-d9a3-4025-8e21-d2f612c6eb49 req-8535030b-49a3-490a-8ac8-812129373a3e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:35.559216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-6ff54445-d9a3-4025-8e21-d2f612c6eb49 req-8535030b-49a3-490a-8ac8-812129373a3e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:35.570077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-6ff54445-d9a3-4025-8e21-d2f612c6eb49 req-8535030b-49a3-490a-8ac8-812129373a3e service nova] Creating event network-changed:a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6 for instance 0e353417-a829-48ae-b2c6-7f590bd74996 on hv-cinder-79987 Jul 29 14:37:35.575233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-6ff54445-d9a3-4025-8e21-d2f612c6eb49 req-8535030b-49a3-490a-8ac8-812129373a3e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029835 Jul 29 14:37:35.576008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 163/318] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:37:36.457051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:36.457670 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:36.459498 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=76 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:36.464243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:36.464694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:36.465504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:36.465941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:36.538558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:36.544212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:36.547352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:36.547965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:36.548844 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:36.549402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:36.646830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:36.655734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b09446b1-ef8c-47ba-a798-fa5fd19597ee tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.202492 Jul 29 14:37:36.657766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 156/319] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:36 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:36.726037 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:36.734846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6decf8ac-fcac-48c3-9567-aa0962a60ca9 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1523 microversion: 2.1 time: 0.201152 Jul 29 14:37:36.736013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 164/320] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:36 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:37.676063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:37.676609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:37.684121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.684940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.685758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.686196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.757036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:37.759356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:37.765906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.766347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.767322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.767763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.918619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:37.926614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9a7047f1-2d80-41e7-b31e-115ed198d0ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1503 microversion: 2.1 time: 0.174367 Jul 29 14:37:37.927084 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 165/321] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:37 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:37.947431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:37.948045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:37.954074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:37.954238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.954675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.955534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:37.955899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:37.967863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2264edc5-15b4-4835-b81c-99ecfe28954e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.295819 Jul 29 14:37:37.968646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 157/322] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:37 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:38.100057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:38.108025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-604d5181-e906-4b4d-9629-520162f0ce31 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1514 microversion: 2.1 time: 0.164261 Jul 29 14:37:38.108581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 166/323] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:37 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:38.988938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:38.989628 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:38.995724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:38.997024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:38.997024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:38.997456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:39.129507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:39.137868 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f092bf5-4bfe-4613-a44e-60372729d83a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.152842 Jul 29 14:37:39.138465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 158/324] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:38 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:40.158729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:40.159348 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:40.162804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:40.163465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=6 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:40.168245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:40.168688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:40.169486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:40.169933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:40.308801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:40.316397 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d8f2b0fa-1561-4e56-9d5d-6d254f26b34e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.161606 Jul 29 14:37:40.316969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 167/325] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:40 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:41.397919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:41.398887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:41.400717 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:41.405505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:41.405950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:41.406711 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:41.407136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:41.538377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:41.545918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-edba6955-79c4-48e7-9f23-a947bebff452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.151903 Jul 29 14:37:41.546485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 159/326] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:41 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:42.567586 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:42.568234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:42.575458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:42.575914 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:42.576688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:42.577157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:42.707116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:42.715288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bd31623a-e46b-484e-a0a3-ff5adfb05bb5 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.151514 Jul 29 14:37:42.715847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 168/327] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:42 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:43.736012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:43.736633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:43.743347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:43.743798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:43.744574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:43.745034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:43.869826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:43.877298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0741fdd5-c42f-47eb-a880-955f25f4111e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.145018 Jul 29 14:37:43.877863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 160/328] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:43 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:44.899932 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:44.901046 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:44.910295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:44.910692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:44.911469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:44.911900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:45.051932 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:45.059428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-74f22c8d-635c-4161-8c8a-b7b3efdeedba tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.164541 Jul 29 14:37:45.060189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 169/329] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:44 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:45.079111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:37:45.085930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:45.087656 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:45.088108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:45.088881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:45.089351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:45.111226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'flavor' on Instance uuid 540afb78-5835-4fc1-9779-59c54f993946 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:37:45.415127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-49a155be-a54f-4fc2-865d-0d444cbec06e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/action" status: 200 len: 32 microversion: 2.1 time: 0.339903 Jul 29 14:37:45.415731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 161/330] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:37:45 2022] POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/action => generated 32 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:37:45.425226 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:45.425834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:45.432721 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:45.433216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:45.434240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:45.434677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:45.559693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:45.567026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9e9bbbf6-ce61-48af-bdb4-dba8c63754b4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.145833 Jul 29 14:37:45.567584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 170/331] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:45 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:46.081698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:46.082413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:46.088626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:46.089188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:46.089956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:46.090392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:46.222878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:46.230667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-accf028a-5f66-4ce0-b489-1eb12032b3c0 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.153443 Jul 29 14:37:46.231225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 162/332] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:46 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:46.587718 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:46.588347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:46.594534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:46.594975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:46.596190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:46.596611 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:46.733946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:46.741456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-472aca39-c948-4051-87b4-4be4d1b0656e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.158090 Jul 29 14:37:46.742393 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 171/333] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:46 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:47.251565 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:47.252208 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:47.258864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:47.259312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:47.260082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:47.260519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:47.519883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:47.527299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-000c4cb8-d015-49cf-a6b4-73065a80268d tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.279537 Jul 29 14:37:47.527853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 163/334] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:47 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:47.762138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:47.762754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:47.769377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:47.769825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:47.770594 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:47.771030 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:47.906786 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:47.914302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-863675ce-5887-415c-af51-7c92f189c5bb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.156241 Jul 29 14:37:47.914876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 172/335] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:47 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:48.547586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:48.548202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:48.554291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:48.555324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:48.556183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:48.556618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:48.691599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:48.699074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d2eda315-682f-47fa-9815-7f92f6269cc7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.155309 Jul 29 14:37:48.699637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 164/336] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:48 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:48.935565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:48.936167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:48.942904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:48.943348 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:48.944103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:48.944533 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:49.073993 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:49.081365 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-94c55a9d-4392-4c7c-b94a-e7538b0e5505 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.149766 Jul 29 14:37:49.081854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 173/337] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:48 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:49.719769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:49.720383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:49.726961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:49.727434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:49.728178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:49.728612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:49.854035 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:49.861574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-365a9756-d250-47fc-b55f-f6d8fdd87155 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.145652 Jul 29 14:37:49.862130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 165/338] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:49 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:50.101869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:50.102503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:50.109229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:50.109677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:50.110439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:50.110871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:50.241499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:50.245072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:50.249823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-13986a7b-3b25-4d69-8e8f-dd3b3ec3ac3a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.151806 Jul 29 14:37:50.250383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 174/339] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:50 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:50.882575 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:50.883189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:50.889404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:50.889849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:50.890621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:50.891056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:51.017745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:51.025565 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-12d06943-bd55-4593-8ce1-e495e4f435c9 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.146800 Jul 29 14:37:51.026130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 166/340] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:50 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:37:51.271830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:51.272448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:51.279605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:51.280058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:51.280955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:51.281470 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:51.409403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:51.417548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-915d9361-963c-4981-8a92-82b09d732e65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.149863 Jul 29 14:37:51.418111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 175/341] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:51 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:52.045951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:52.046559 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:52.052542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:52.052981 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:52.053770 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:52.054193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:52.192852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:52.200937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1cea997e-30c6-49f1-956f-bee2ce6311c2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.158611 Jul 29 14:37:52.201596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 167/342] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:52 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:52.439156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:52.439774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:52.446315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:52.446778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:52.447558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:52.448003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:52.588592 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:52.596031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-813a05e6-55e5-4328-9dd2-3f37737e21e3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.160864 Jul 29 14:37:52.596572 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 176/343] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:52 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:53.229338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:53.229338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:53.229338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:53.229889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:53.230505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:53.230943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:53.249970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:53.360516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:53.367718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-098d23a7-b755-45eb-aed7-298df2d27423 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.149558 Jul 29 14:37:53.368308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 168/344] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:53 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:53.617642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:53.618257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:53.624818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:53.625304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:53.626079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:53.626516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:53.751750 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:53.759726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f0c24561-a01b-4e16-9284-8f8fda546b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.146130 Jul 29 14:37:53.760280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 177/345] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:53 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:54.389131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:54.389743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:54.395939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:54.396392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:54.397208 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:54.397648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:54.529708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:54.537061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a9f402d5-7326-41a9-ade3-003eb9a08de8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.152181 Jul 29 14:37:54.537630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 169/346] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:54 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:54.780520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:54.781165 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:54.787798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:54.788240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:54.789395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:54.789869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:54.916581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:54.923929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ab8e9cf5-c107-4c9e-b5ea-c9d4f74f0e8f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.147227 Jul 29 14:37:54.924482 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 178/347] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:54 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:55.557531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:55.558177 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:55.564573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:55.565041 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:55.565811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:55.566246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:55.690673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:55.698172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f178900-011e-4253-8b9b-a386e2219c1a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.144540 Jul 29 14:37:55.698752 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 170/348] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:55 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:55.946202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:55.946812 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:55.953642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:55.954097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:55.954875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:55.955316 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:56.279689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:56.287120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-825149e6-0bfa-45a8-840f-21a2724e801d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.345315 Jul 29 14:37:56.287682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 179/349] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:55 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:56.718972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:56.719587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:56.725479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:56.725925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:56.727078 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:56.727699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:56.854491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:56.861711 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-842bc51a-827d-4c4e-a828-e66ba947c7fa tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.146574 Jul 29 14:37:56.862265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 171/350] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:56 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:57.309398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:57.309912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:57.316620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:57.317098 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:57.317866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:57.318299 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:57.452086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:57.459598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-38804c70-7b54-4cb1-8d77-d5a196c2b6c6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.155364 Jul 29 14:37:57.460188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 180/351] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:57 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:57.882448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:57.883153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:57.891786 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:57.892070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:57.892847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:57.893306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:58.112961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:58.124067 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-31cdccbc-7af9-4b9b-a70c-20bbabfee2b2 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.245388 Jul 29 14:37:58.124737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 172/352] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:57 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:58.480462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:58.485406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:58.487491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:58.487906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:58.488686 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:58.489153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:58.631380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:58.638866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-45b89b5b-3e42-4771-b44e-cdb6b3fcdfe6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.162776 Jul 29 14:37:58.639412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 181/353] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:58 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:59.152456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:59.153744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:59.161929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:59.162381 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:59.163690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:59.164209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:59.302762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:59.310972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9cb6b241-ff0b-4739-95a0-9f48039c285b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.163643 Jul 29 14:37:59.311536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 173/354] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:59 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:37:59.661447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:37:59.662369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:37:59.664813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:37:59.670296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:59.671279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:59.672206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:37:59.672882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:37:59.818879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:37:59.826448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-32d2bc2b-90cd-4337-92ad-9a77484a934e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.168920 Jul 29 14:37:59.827014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 182/355] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:37:59 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:00.332125 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:00.332739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:00.339393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:00.340111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:00.340643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:00.341109 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:00.466277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:00.473727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1bdd3959-55a0-489f-b15e-2714dfd0ebc1 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.145463 Jul 29 14:38:00.474281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 174/356] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:00 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:00.846963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:00.847567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:00.854559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:00.855007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:00.855764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:00.856195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:00.987995 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:00.994994 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-07786c77-42c7-4c99-bdaa-1b13fe55bc52 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.151685 Jul 29 14:38:00.995499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 183/357] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:00 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:01.494448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:01.494971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:01.500949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:01.501421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:01.502183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:01.502617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:01.630870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:01.638830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0f59e5fd-7daf-4ea3-a59c-e25338a1da8a tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.148260 Jul 29 14:38:01.639385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 175/358] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:01 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:02.016471 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:02.017156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:02.024482 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:02.024936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:02.025853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:02.026295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:02.154253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:02.161980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad80c8fa-06eb-450a-91b5-540fcc2d9ff0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.149431 Jul 29 14:38:02.162763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 184/359] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:02 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:02.658939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:02.659546 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:02.666081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:02.666529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:02.667282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:02.667741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:02.799523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:02.808516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a714512a-4c4e-4893-b569-09b6111df5a8 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.153180 Jul 29 14:38:02.809265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 176/360] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:02 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:03.182661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:03.183531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:03.189970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:03.190421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:03.191207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:03.191641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:03.319903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:03.327912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-75c6a2fc-9e8a-4f81-b973-006f7b245c4c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.149045 Jul 29 14:38:03.330558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 185/361] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:03 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:03.829405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:03.830026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:03.835984 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:03.836437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:03.837231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:03.837677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:03.967765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:03.975113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5bbdf495-de81-4627-a567-0285f9997750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.149455 Jul 29 14:38:03.975700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 177/362] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:03 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:04.348665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:04.349304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:04.357044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:04.357044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:04.357240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:04.357569 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:04.499954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:04.507676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1901f7f6-24ed-464b-911c-04a9bb253768 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.162791 Jul 29 14:38:04.509097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 186/363] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:04 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:04.997607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:04.998233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:05.004031 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:05.004478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:05.005266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:05.005698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:05.133418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:05.140789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-88f164a2-fda8-462d-84c6-c2fa4ef9b978 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.147025 Jul 29 14:38:05.141391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 178/364] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:04 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:05.529049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:05.529701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:05.536200 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:05.536649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:05.537445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:05.537886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:05.663638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:05.671584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8d75eb88-d40e-45e4-9501-0fc878c0f851 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.146495 Jul 29 14:38:05.672147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 187/365] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:05 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:06.161275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:06.161885 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:06.168611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:06.169088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:06.169855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:06.170281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:06.295939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:06.303317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-05b426b7-a8b9-4f20-9723-e1c65dfcf750 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.146035 Jul 29 14:38:06.303874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 179/366] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:06 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:06.693068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:06.693680 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:06.700852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:06.701367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:06.702142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:06.702578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:06.837404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:06.844724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cc1295e3-dceb-4202-82e7-f8ee0d9ac86e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.155513 Jul 29 14:38:06.845310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 188/367] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:06 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:07.324061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:07.324663 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:07.326512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=48 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:07.331154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:07.331598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:07.332354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:07.332783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:07.462538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:07.469809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4ccbd958-c0ec-4d78-b718-9d47a22cb581 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.150007 Jul 29 14:38:07.470364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 180/368] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:07 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:07.865288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:07.865895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:07.872237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:07.872682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:07.873471 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:07.873900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:07.999783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:08.007543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f4080ec8-0599-4e1f-8fc2-4e8528cce710 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.145971 Jul 29 14:38:08.008886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 189/369] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:07 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:08.490805 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:08.491325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:08.497842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:08.498289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:08.499051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:08.499484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:08.625138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:08.632390 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e79cbcce-63e8-47f2-81da-a3dcd75f2525 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.145517 Jul 29 14:38:08.633583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 181/370] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:08 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:08.965404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-56c2a44b-4da2-45b9-9da4-464caf45b64a req-8ee8b065-bfb8-49b1-af76-6be7976cd857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e353417-a829-48ae-b2c6-7f590bd74996", "name": "network-vif-plugged", "status": "completed", "tag": "a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:08.975350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-56c2a44b-4da2-45b9-9da4-464caf45b64a req-8ee8b065-bfb8-49b1-af76-6be7976cd857 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:08.975823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-56c2a44b-4da2-45b9-9da4-464caf45b64a req-8ee8b065-bfb8-49b1-af76-6be7976cd857 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:08.987211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-56c2a44b-4da2-45b9-9da4-464caf45b64a req-8ee8b065-bfb8-49b1-af76-6be7976cd857 service nova] Creating event network-vif-plugged:a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6 for instance 0e353417-a829-48ae-b2c6-7f590bd74996 on hv-cinder-79987 Jul 29 14:38:08.992820 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-56c2a44b-4da2-45b9-9da4-464caf45b64a req-8ee8b065-bfb8-49b1-af76-6be7976cd857 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030610 Jul 29 14:38:08.993442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 190/371] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:38:09.031081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:09.033167 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:09.041116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:09.042046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:09.043138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:09.044478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:09.188069 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:09.206137 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a5cdecf5-7c66-42a4-bf8a-7b8d52de86ba tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.170729 Jul 29 14:38:09.206137 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 182/372] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:09 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:09.655023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:09.655646 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:09.661875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:09.662322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:09.663380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:09.663855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:09.793567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:09.801148 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f9623b8c-1dc7-4dfa-b877-5a3c1196fd6b tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.150424 Jul 29 14:38:09.801695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 191/373] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:09 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:10.224878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:10.225515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:10.231726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:10.232174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:10.232939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:10.233404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:10.357421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:10.364709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dcadb58a-8e26-499e-a2ab-46a1c91f64bc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.143827 Jul 29 14:38:10.365309 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 183/374] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:10 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:10.824166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:10.824905 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:10.831388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:10.831833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:10.832588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:10.833038 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:10.837228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:10.965436 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:10.973282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2a4711df-f050-4f23-908a-0cc0dfc2be06 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.153621 Jul 29 14:38:10.973840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 192/375] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:10 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:11.387330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:11.388348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:11.394247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:11.394687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:11.395444 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:11.395876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:11.523711 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:11.531601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ca277ad-325d-48f8-b7b7-124150f02742 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.148369 Jul 29 14:38:11.532180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 184/376] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:11 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:11.995551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:11.996160 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:12.002636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:12.003081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:12.003835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:12.004265 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:12.135153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:12.142486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-af7fd1ad-28ef-4409-96aa-605b29747527 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1313 microversion: 2.1 time: 0.151520 Jul 29 14:38:12.143047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 193/377] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:11 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:12.553001 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:12.553619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:12.560524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:12.560971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:12.561764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:12.562274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:12.566110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:12.690446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:12.697907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9b9750d2-44eb-4f72-8c83-156ae5a55b0e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.148702 Jul 29 14:38:12.698469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 185/378] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:12 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:13.163064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:13.163703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:13.170556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:13.171000 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:13.171768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:13.172598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:13.305372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:13.313270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad6b0878-bcc2-4827-b436-34492208c494 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1497 microversion: 2.1 time: 0.153948 Jul 29 14:38:13.313834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 194/379] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:13 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:13.719142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:13.719708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:13.725699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:13.726149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:13.726917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:13.727974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:13.856181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:13.863536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d535b5ae-81e8-4f43-af3b-f83551b2167f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.148417 Jul 29 14:38:13.864095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 186/380] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:13 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:14.884936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:14.885567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:14.892050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:14.892493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:14.893279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:14.893708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:15.024534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:15.032118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9ee994f1-faf8-4493-ac79-8849a3fadf7c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.151913 Jul 29 14:38:15.032669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 195/381] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:14 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:16.052296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:16.052910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:16.059791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:16.067132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:16.067132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:16.067132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:16.187684 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:16.195045 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-def86173-cd47-41ae-bb69-b4d315922040 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.146669 Jul 29 14:38:16.195604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 187/382] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:16 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:17.216168 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:17.216763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:17.222948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:17.229686 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:17.229686 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:17.229686 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:17.355734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:17.363206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ef21d20a-356f-4027-8d8b-9d75827b7b72 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.151428 Jul 29 14:38:17.363762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 196/383] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:17 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:18.383384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:18.384033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:18.390169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:18.390619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:18.391393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:18.391831 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:18.520375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:18.527983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6265023e-3632-46ff-b18c-5926da22f79e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.148359 Jul 29 14:38:18.528548 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 188/384] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:18 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:19.549868 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:19.550496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:19.557451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:19.558170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:19.559005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:19.559444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:19.688015 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:19.695357 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-60d64fbb-99d0-4aed-91e5-b283ea39decc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.149475 Jul 29 14:38:19.695912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 197/385] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:19 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:20.211263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:20.211757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:20.218270 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.218718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.219483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.219922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.244259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:38:20.560878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dffdfd75-19ef-42c6-9cc7-cf7a91896310 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 204 len: 0 microversion: 2.1 time: 0.353126 Jul 29 14:38:20.561498 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 189/386] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:38:20 2022] DELETE /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:38:20.569835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:20.570518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:20.577920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.578446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.579487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.579937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.713955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:20.716873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:20.717589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:20.721780 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-10a51dcc-448f-466c-b773-b51cd64536e7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.155778 Jul 29 14:38:20.722343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 198/387] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:20 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:20.728718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.728718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.728718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:20.728718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:20.855832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:20.863842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-38a9777b-99c3-454f-946c-9aed0a73e525 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.151821 Jul 29 14:38:20.864604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 190/388] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:20 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:21.742395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:21.747577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:21.749971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:21.750415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:21.751175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:21.751608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:21.886503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:21.887701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:21.894515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:21.895306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:21.896619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:21.897392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:21.907401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:21.914933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-35de34f4-c436-4d51-aa35-2c761e4aec4e tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.176392 Jul 29 14:38:21.915631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 199/389] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:21 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:22.038294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:22.046343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fc337d10-e935-428f-b9eb-9b37f75ea0d3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.164810 Jul 29 14:38:22.046911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 191/390] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:21 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:22.937310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:22.937876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:22.944815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:22.945293 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:22.946048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:22.946478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:23.068809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:23.069537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:23.076268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:23.076719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:23.077510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:23.077947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:23.079877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:23.087372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-613c46d8-c074-4038-b35f-bfb41f52b780 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.153984 Jul 29 14:38:23.087931 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 200/391] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:22 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:23.205359 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:23.212830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d8c6bf08-fb10-44a3-ac44-0584e64cb819 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.147824 Jul 29 14:38:23.213987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 192/392] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:23 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:24.109068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:24.109665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:24.116129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:24.116570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:24.117361 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:24.117792 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:24.233616 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:24.234223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:24.240589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:24.241141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:24.241909 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:24.242343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:24.245800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:24.253506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-72c60859-1591-4d5c-8228-be09c57e38c3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.148442 Jul 29 14:38:24.254173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 201/393] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:24 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:24.374532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:24.382116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ec568cc9-079a-4161-a7bd-fd0a3f52b833 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.152311 Jul 29 14:38:24.382702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 193/394] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:24 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:25.275090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:25.275813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:25.282339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:25.282791 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:25.283555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:25.284000 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:25.402796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:25.403412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:25.409634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:25.410026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:25.410810 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:25.411253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:25.413613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:25.421223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0b52026c-a926-413a-9d10-7cdb599ad356 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.149885 Jul 29 14:38:25.421793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 202/395] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:25 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:25.537816 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:25.545654 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e73c2713-c779-494c-b0d2-8c5a70934033 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.147357 Jul 29 14:38:25.546217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 194/396] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:25 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:26.442952 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:26.443620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:26.450830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:26.451280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:26.452048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:26.452488 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:26.567108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:26.567720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:26.574871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:26.575327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:26.576112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:26.576551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:26.585633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:26.590836 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2a21be94-bb61-45e5-bf1e-87981b497172 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.151639 Jul 29 14:38:26.591407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 203/397] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:26 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:26.702086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:26.709587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a9d3d9fb-b549-4df4-be65-f2ddb3ad06e0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.146305 Jul 29 14:38:26.710144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 195/398] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:26 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:27.614112 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:27.614725 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:27.621366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:27.621813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:27.622575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:27.623009 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:27.731006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:27.731613 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:27.737479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:27.737972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:27.738747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:27.739169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:27.761718 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:27.770044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5025cdfd-c3e6-4d6b-896a-787d11d59d31 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.159774 Jul 29 14:38:27.770835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 204/399] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:27 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:27.879477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:27.887551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ba785aa0-617a-4be8-b30b-54ea7120c8c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.160399 Jul 29 14:38:27.888104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 196/400] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:27 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:28.790914 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:28.792313 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:28.799958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:28.800813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:28.802220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:28.803002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:28.907597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:28.908217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:28.914233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:28.914682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:28.915448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:28.915901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:28.939420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:28.946917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9be754d7-9c94-41b3-bc4e-4e489645a314 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.159811 Jul 29 14:38:28.947504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 205/401] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:28 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:29.048194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:29.055865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6bfd4775-b611-4d5d-af45-5fa9639abca4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.152104 Jul 29 14:38:29.056435 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 197/402] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:28 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:29.968099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:29.969800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:29.971163 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=48 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:29.976106 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:29.976562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:29.977389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:29.977849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:30.076860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:30.077605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:30.083951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:30.086927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:30.087846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:30.088297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:30.111238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:30.119153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9c013220-ab49-4ad8-b599-f3f9578855f7 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1503 microversion: 2.1 time: 0.155488 Jul 29 14:38:30.119724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 206/403] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:29 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:30.231418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:30.238804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef9db7b6-545d-41ee-ac20-5b050050be2b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.165925 Jul 29 14:38:30.239542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 198/404] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:30 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:31.140514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:31.141174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:31.147660 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:31.148115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:31.148894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:31.149364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:31.173088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-bd2ffd4e-3175-4221-9624-90e8eb22ceef req-b7b17032-8421-4879-a7fd-9c9a405cfb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e353417-a829-48ae-b2c6-7f590bd74996", "name": "network-vif-deleted", "tag": "a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:31.183695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-bd2ffd4e-3175-4221-9624-90e8eb22ceef req-b7b17032-8421-4879-a7fd-9c9a405cfb46 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:31.184171 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-bd2ffd4e-3175-4221-9624-90e8eb22ceef req-b7b17032-8421-4879-a7fd-9c9a405cfb46 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:31.195491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-bd2ffd4e-3175-4221-9624-90e8eb22ceef req-b7b17032-8421-4879-a7fd-9c9a405cfb46 service nova] Creating event network-vif-deleted:a57ff4bd-214c-4abd-80dc-fdfd8b48dfb6 for instance 0e353417-a829-48ae-b2c6-7f590bd74996 on hv-cinder-79987 Jul 29 14:38:31.201526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-bd2ffd4e-3175-4221-9624-90e8eb22ceef req-b7b17032-8421-4879-a7fd-9c9a405cfb46 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031838 Jul 29 14:38:31.202215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 199/405] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:38:31.220291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:31.227937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-28b9879a-7d1d-4122-b9bd-346139d19d52 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1461 microversion: 2.1 time: 0.091398 Jul 29 14:38:31.228498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 207/406] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:31 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1461 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:31.260139 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:31.260852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:31.267204 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:31.267651 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:31.268404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:31.268840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:31.405767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:31.409446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:31.413763 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a74056c-2724-4f21-a275-089f099e7aea tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.157856 Jul 29 14:38:31.414321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 200/407] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:31 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:32.249423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:32.249974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:32.256692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.257185 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.257957 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.258389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.290745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.291185 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.291627 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 0e353417-a829-48ae-b2c6-7f590bd74996 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:38:32.294350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:32.336487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:32.344336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ee713999-8316-4748-bd13-c50c7f8bfe02 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1303 microversion: 2.1 time: 0.099380 Jul 29 14:38:32.345257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 208/408] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:32 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:38:32.437338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:32.437969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:32.444556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.445023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.445895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.446632 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.578111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:32.585384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dbd5b875-7124-44e8-9628-5acb0729519d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1500 microversion: 2.1 time: 0.153070 Jul 29 14:38:32.585943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 201/409] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:32 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1500 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:32.614081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "315eb4ef-2c28-414e-95c7-80369e8fc8f4"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:32.616425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:32.623566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.624015 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.624783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.625249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.647108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] HTTP exception thrown: Cannot 'attach_volume' instance 540afb78-5835-4fc1-9779-59c54f993946 while it is in vm_state rescued Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Request method failure captured: Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/os-volume_attachments HTTP/1.1 Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 74 Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BE_a6vp_K8n1-US6WzucaZhFMyenbjTPUTnVeyOSxu0FM6xOYjY0UB936Vly2_5OLEouw-KH2CvHYYf4xrIhLlbVPEdTXfzXd9jGJ3V5sZ3BgahC6p8sX-WkwP_t4v9-Z2eD71KczBhgeGnaDpRwCFHhdvZZm0DSsNYnPYVSixxps Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:38:32.648764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82cd919860e249acb9dea7620506725b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82cd919860e249acb9dea7620506725b"}]}] Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f4ae3fb6a7954a24b88df4f35f55020c Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {"volumeAttachment": {"volumeId": "315eb4ef-2c28-414e-95c7-80369e8fc8f4"}} Jul 29 14:38:32.650396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Cannot 'attach_volume' instance 540afb78-5835-4fc1-9779-59c54f993946 while it is in vm_state rescued Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'server_id': '540afb78-5835-4fc1-9779-59c54f993946', 'body': {'volumeAttachment': {'volumeId': '315eb4ef-2c28-414e-95c7-80369e8fc8f4'}}} Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 540afb78-5835-4fc1-9779-59c54f993946 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:38:32.651147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 540afb78-5835-4fc1-9779-59c54f993946 while it is in vm_state rescued Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:38:32.652720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 540afb78-5835-4fc1-9779-59c54f993946 while it is in vm_state rescued Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Returning 409 to user: Cannot 'attach_volume' instance 540afb78-5835-4fc1-9779-59c54f993946 while it is in vm_state rescued {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-098f617c-afe3-4add-a3cc-6ba40874c316 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040295 Jul 29 14:38:32.653781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 209/410] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:38:32 2022] POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 14:38:32.659457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:32.659993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:32.665903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.666349 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.667641 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.668084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.897886 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2bec4590-1bd5-48f6-b60f-9404120c9069 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/action" status: 202 len: 0 microversion: 2.1 time: 0.242014 Jul 29 14:38:32.898443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 202/411] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:38:32 2022] POST /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:38:32.907461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:32.908073 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:32.914182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.914631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:32.915439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:32.915876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:33.048314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:33.055882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3a44fdd2-1675-4831-80f6-63910d6232e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.152365 Jul 29 14:38:33.056441 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 210/412] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:32 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:33.366423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:33.367111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:33.373666 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:33.374112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:33.374873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:33.375355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:33.407261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:33.407749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:33.408191 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 0e353417-a829-48ae-b2c6-7f590bd74996 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:38:33.683476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:33.690855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bd9b8ef0-011f-4750-a512-b13f230cddea tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1303 microversion: 2.1 time: 0.328963 Jul 29 14:38:33.691420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 203/413] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:33 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1303 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:34.078023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:34.078584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:34.085042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:34.085491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:34.086248 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:34.086680 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:34.213765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:34.221343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-762e03f5-3bb6-41c5-9316-d1beafc364a0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.147228 Jul 29 14:38:34.221890 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 211/414] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:34 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:34.711342 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:34.711978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:34.718787 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:34.719237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:34.719999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:34.720434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:34.750880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:34.751257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:34.751703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 0e353417-a829-48ae-b2c6-7f590bd74996 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:38:34.790021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:34.798163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9c55b90d-6f77-4a4e-9d3e-5c3c6ad68149 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1303 microversion: 2.1 time: 0.090677 Jul 29 14:38:34.798726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 204/415] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:34 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1303 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:35.242524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:35.243129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:35.250387 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:35.250833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:35.251587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:35.252017 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:35.383095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:35.391320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4f397252-8278-46cd-a6e7-9d5af4441061 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.152717 Jul 29 14:38:35.391877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 212/416] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:35 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:35.818937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:35.819573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:35.825724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:35.826169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:35.826922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:35.827348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:35.856802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:35.857292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:35.857733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 0e353417-a829-48ae-b2c6-7f590bd74996 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:38:35.896766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:35.904821 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-312d6cf2-2b43-440f-b4b6-27a1a0302452 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1303 microversion: 2.1 time: 0.089727 Jul 29 14:38:35.905408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 205/417] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:35 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1303 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:36.412675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:36.413232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:36.419639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:36.420078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:36.420835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:36.421291 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:36.546830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:36.554342 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9b8fdb11-c76a-4f83-b66c-93e16757745d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.145597 Jul 29 14:38:36.554885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 213/418] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:36 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:36.926036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:36.941413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:36.941413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:36.941413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:36.941413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:36.941791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:36.965558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:36.966004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:36.966446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lazy-loading 'fault' on Instance uuid 0e353417-a829-48ae-b2c6-7f590bd74996 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:38:37.005956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227203ab050f43f793d8c4fe3c31497d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8ee55d2489d40f480f2fc2772712744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:37.013734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fc77cb79-3ada-42a7-85a6-cfeda165a1f3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 200 len: 1303 microversion: 2.1 time: 0.091505 Jul 29 14:38:37.014298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 206/419] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:36 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:37.575063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:37.575742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:37.582237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:37.582691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:37.583458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:37.583892 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:37.730315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:37.738650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d85cd84d-8c86-4849-87e9-da059fc78321 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.167539 Jul 29 14:38:37.739411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 214/420] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:37 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:38.034424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:38.035027 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] [instance: 0e353417-a829-48ae-b2c6-7f590bd74996] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:38.036966 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:38.042597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:38.043081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:38.043901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:38.044339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:38.059080 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] HTTP exception thrown: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Request method failure captured: Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 HTTP/1.1 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_CGnx54JD5hSmaWhA0ZSI6MiX-v1BjZaKqEuiY53JFUzFGQiUXj9ydI-1wmsT6N-fCBL4_w8SlgeHq-j6ayn-TQyKK5xgsD74hQ_nN6tzFdu4kP481VSW-i87AGgecRc04VuQEfa28Y0E_7vY_WuIj6zjzX0KuHP7Om7hazU4VaFkY Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: a8ee55d2489d40f480f2fc2772712744 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesActionsTest-2060208933 Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:38:38.060673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a8ee55d2489d40f480f2fc2772712744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a8ee55d2489d40f480f2fc2772712744"}]}] Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesActionsTest-2060208933 Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: a8ee55d2489d40f480f2fc2772712744 Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesActionsTest-2060208933 Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesActionsTest-2060208933-project Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 227203ab050f43f793d8c4fe3c31497d Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesActionsTest-2060208933-project Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. Jul 29 14:38:38.062180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '0e353417-a829-48ae-b2c6-7f590bd74996'} Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:38:38.063023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. Jul 29 14:38:38.064485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:38:38.067827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] Returning 404 to user: Instance 0e353417-a829-48ae-b2c6-7f590bd74996 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:38:38.067827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2fd4d56d-2f05-4a7d-a3a0-7eef569599d3 tempest-VolumesActionsTest-2060208933 tempest-VolumesActionsTest-2060208933-project] 10.222.0.49 "GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996" status: 404 len: 111 microversion: 2.1 time: 0.031496 Jul 29 14:38:38.067827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 207/421] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:38 2022] GET /compute/v2.1/servers/0e353417-a829-48ae-b2c6-7f590bd74996 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:38:38.760536 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:38.761155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:38.769757 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:38.770540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:38.771420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:38.772286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:38.925149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:38.933342 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a140fa29-e575-4e1a-b8d6-022a5bdbf266 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.176776 Jul 29 14:38:38.933903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 215/422] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:38 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:39.954484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:39.955099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:39.961372 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:39.961823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:39.962588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:39.963028 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:40.095809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:40.103044 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2ec73ede-a462-40e4-9131-0b898448ac89 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.152404 Jul 29 14:38:40.103611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 208/423] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:39 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:41.125093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:41.125632 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:41.132140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:41.132587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:41.133380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:41.133817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:41.261217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:41.268682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d2042474-1c4e-4e2c-b5b8-acba2bedfd05 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.147554 Jul 29 14:38:41.269277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 216/424] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:41 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:42.288580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:42.289219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:42.295743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:42.296192 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:42.296960 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:42.297417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:42.424642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:42.432776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-33769bf5-abd5-4de2-b55f-4a60462cf40a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.147227 Jul 29 14:38:42.433370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 209/425] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:42 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:43.453745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:43.454352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:43.460850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:43.461326 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:43.462083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:43.462518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:43.595608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:43.603233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ab3c4edd-e8c0-4574-9a85-f900ab715bcc tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.153269 Jul 29 14:38:43.603771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 217/426] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:43 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:44.624820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:44.625912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:44.632301 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:44.632822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:44.633811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:44.634320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:44.765539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:44.772878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-30146161-4bb0-40ac-8ff1-6eda1f32b085 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.152345 Jul 29 14:38:44.773472 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 210/427] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:44 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:45.794720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:45.795336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:45.801576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:45.802174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:45.802946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:45.803386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:45.930392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:45.937926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3f4f136a-9f73-448c-b9d1-3face3dbab03 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1508 microversion: 2.1 time: 0.147719 Jul 29 14:38:45.938481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 218/428] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:45 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:46.969776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:46.970312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:46.976311 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:46.976761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:46.977571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:46.978006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:47.111495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:47.118834 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b44273b7-6532-4d31-98d5-93c8904f1274 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1514 microversion: 2.1 time: 0.153011 Jul 29 14:38:47.119412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 211/429] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:46 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:49.988435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: .version_select at 0x7f6810206940>, body: {"keypair": {"name": "tempest-keypair-1074115082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKOR21yIDRztyZHkWeNrZxCFlNHZIsFJGPRgmjEdlMIU+wwq+C/GRjji+jH6+au6947+gSBqUyb/fCP6y9J+ORkSctXVW61koSZ1bPcJ40lJlCQJu6kD0KoGfhRyA8u4w=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:50.005743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for project 82cd919860e249acb9dea7620506725b. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:38:50.010699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for user f4ae3fb6a7954a24b88df4f35f55020c and project 82cd919860e249acb9dea7620506725b. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:38:50.024849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR oslo.messaging._drivers.impl_rabbit [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [c8950ffc-9a5e-4ffc-b18d-ec130c5c9e66] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 14:38:51.042534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [c8950ffc-9a5e-4ffc-b18d-ec130c5c9e66] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45398. Jul 29 14:38:51.127020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-69ef31cf-de6a-4a4e-9f89-623a6d2e2c65 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.142035 Jul 29 14:38:51.128630 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 219/430] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:38:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:38:53.803933 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-321525922", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "490a78c0-d227-4aa8-8200-48bd37fbf557"}], "security_groups": [{"name": "tempest-securitygroup--77684090"}], "key_name": "tempest-keypair-1074115082", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:38:53.956303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] validate_networks() for [('490a78c0-d227-4aa8-8200-48bd37fbf557', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:38:54.440917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:38:54.441366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:38:54.441839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:38:54.442252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:38:54.442662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:38:54.455284 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:54.455744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:54.456512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:54.456930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:54.476140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:38:54.481467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Getting quotas for user f4ae3fb6a7954a24b88df4f35f55020c and project 82cd919860e249acb9dea7620506725b. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:38:54.493756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:38:54.497439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:38:54.638572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [2bd49628-0728-449d-9b0e-bf8d6ce919eb] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 29 14:38:55.648750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [2bd49628-0728-449d-9b0e-bf8d6ce919eb] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 45514. Jul 29 14:38:55.665232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a3ca0d55-5152-4410-b4af-b5c5f5a1c429 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.865492 Jul 29 14:38:55.675062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 212/431] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:38:53 2022] POST /compute/v2.1/servers => generated 407 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:38:55.678264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0ed05ac3-5dac-4c4a-88c0-2e89b95120dd tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:55.679446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0ed05ac3-5dac-4c4a-88c0-2e89b95120dd tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:55.750072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0ed05ac3-5dac-4c4a-88c0-2e89b95120dd tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:55.758258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0ed05ac3-5dac-4c4a-88c0-2e89b95120dd tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1245 microversion: 2.1 time: 0.083791 Jul 29 14:38:55.777249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 220/432] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:55 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:56.798826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:56.799450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:56.805926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:56.807267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:56.808413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:56.808942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:56.907706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:56.907706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4d2b6025-3992-4487-8520-9f13bb386948 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1249 microversion: 2.1 time: 0.098914 Jul 29 14:38:56.907706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 213/433] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:56 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:57.923071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:57.924164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:57.928216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=60 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:38:57.934640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:57.936058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:57.936802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:57.937573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:58.012043 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:58.023874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1cf695ec-dde2-4ed5-be9c-020c34001019 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1297 microversion: 2.1 time: 0.105368 Jul 29 14:38:58.024805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 221/434] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:57 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:38:59.047209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:38:59.048569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:38:59.056319 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:59.059597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:59.059597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:38:59.059597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:38:59.129841 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:38:59.140713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-48847ade-bfad-4afc-a91f-8c9ea3b2b1ce tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1303 microversion: 2.1 time: 0.098485 Jul 29 14:38:59.141733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 214/435] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:38:59 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:00.163471 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:00.164260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:00.166682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:00.175220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:00.175676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:00.176468 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:00.176908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:00.343989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:00.352545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-27db79e7-9133-4cde-ad96-45fcf9bc0cd3 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.193440 Jul 29 14:39:00.353759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 222/436] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:00 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:00.592430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-81af63c0-1074-44ba-a332-d10dff56df6d req-c30bc2f6-c62a-4d52-acd6-a7842eff75f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:00.620633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-81af63c0-1074-44ba-a332-d10dff56df6d req-c30bc2f6-c62a-4d52-acd6-a7842eff75f7 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:00.620633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-81af63c0-1074-44ba-a332-d10dff56df6d req-c30bc2f6-c62a-4d52-acd6-a7842eff75f7 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:00.644603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-81af63c0-1074-44ba-a332-d10dff56df6d req-c30bc2f6-c62a-4d52-acd6-a7842eff75f7 service nova] Creating event network-changed:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:39:00.654223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-81af63c0-1074-44ba-a332-d10dff56df6d req-c30bc2f6-c62a-4d52-acd6-a7842eff75f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073409 Jul 29 14:39:00.655555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 215/437] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:39:01.374617 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:01.375433 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:01.382801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:01.383586 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:01.385361 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:01.386256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:01.535999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:01.545044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-efd50438-8fdb-4b4e-9f14-e8d28cebdc5b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.174290 Jul 29 14:39:01.557018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 223/438] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:01 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:02.156603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:39:02.157315 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:39:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:39:02.571496 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:02.573116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:02.581768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:02.582244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:02.583039 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:02.583514 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:02.586576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:03.030064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:03.038827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1d1a780f-746e-4e67-87ad-71b41ff566e7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.471737 Jul 29 14:39:03.040043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 216/439] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:02 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:04.060777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:04.061588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:04.070556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:04.071323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:04.072864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:04.073497 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:04.216559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:04.226360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b07720ba-9c66-413c-a4e3-5dc283d77c3f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.170456 Jul 29 14:39:04.227300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 224/440] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:04 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:05.250523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:05.251086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:05.252915 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:05.254118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:05.259103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:05.259554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:05.260950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:05.261425 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:05.390450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:05.397775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ddabd41e-b178-44f8-bf23-e95d6b685f02 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.151450 Jul 29 14:39:05.398332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 217/441] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:05 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:39:06.419749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:06.420846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:06.424386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=6 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:06.430045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:06.430495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:06.431647 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:06.432207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:06.564405 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:06.572271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ba2140d8-a359-485a-8617-26abc343f8eb tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.157079 Jul 29 14:39:06.573766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 225/442] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:06 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:07.593875 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:07.594491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:07.600620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:07.601116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:07.601890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:07.602332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:07.736086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:07.743536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ee5ef5e-610a-46af-beea-8acb515fdac0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.153523 Jul 29 14:39:07.744109 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 218/443] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:07 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:08.171402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-fd0bb190-c3d9-43eb-b797-470e913e085c req-ebac099a-8832-4c7a-b543-084a1de3a3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "name": "network-vif-plugged", "status": "completed", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:08.181839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-fd0bb190-c3d9-43eb-b797-470e913e085c req-ebac099a-8832-4c7a-b543-084a1de3a3ca service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:08.182942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-fd0bb190-c3d9-43eb-b797-470e913e085c req-ebac099a-8832-4c7a-b543-084a1de3a3ca service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:08.193738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-fd0bb190-c3d9-43eb-b797-470e913e085c req-ebac099a-8832-4c7a-b543-084a1de3a3ca service nova] Creating event network-vif-plugged:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:39:08.199604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-fd0bb190-c3d9-43eb-b797-470e913e085c req-ebac099a-8832-4c7a-b543-084a1de3a3ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032490 Jul 29 14:39:08.200481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 226/444] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:08.764075 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:08.764926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:08.770570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:08.774267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:08.774267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:08.774267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:08.907029 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:08.914620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a0c4030b-c6c5-4e7d-81b5-a68ea60f909e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.154518 Jul 29 14:39:08.915182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 219/445] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:08 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:39:09.937110 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:09.937886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:09.945323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:09.945783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:09.946563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:09.947007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:10.083729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:10.091415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0f6ac25d-b4ca-41e7-ac4e-621dcb5683d8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1369 microversion: 2.1 time: 0.159286 Jul 29 14:39:10.098501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 227/446] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:09 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:39:11.112371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:11.113016 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:11.114746 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:11.121976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:11.123897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:11.124653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:11.125152 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:11.257739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:11.266072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5bf7d2ff-5f76-4b4f-8df3-d609ef96dd22 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1564 microversion: 2.1 time: 0.157532 Jul 29 14:39:11.266629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 220/447] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:11 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:11.286830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:11.287314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:11.293955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:11.294603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:11.295539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:11.296137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:11.377045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-28778389-114c-4b93-a3a1-b79972e496c0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093956 Jul 29 14:39:11.384657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 228/448] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:39:11 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:12.735571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-ecbad528-85df-41bc-bf02-0f6da31fe6c1 req-915f316b-9b99-4f6f-ad89-e5e81d0dc18e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:12.748616 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-ecbad528-85df-41bc-bf02-0f6da31fe6c1 req-915f316b-9b99-4f6f-ad89-e5e81d0dc18e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:12.750062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-ecbad528-85df-41bc-bf02-0f6da31fe6c1 req-915f316b-9b99-4f6f-ad89-e5e81d0dc18e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:12.765743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-ecbad528-85df-41bc-bf02-0f6da31fe6c1 req-915f316b-9b99-4f6f-ad89-e5e81d0dc18e service nova] Creating event network-changed:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:39:12.772095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-ecbad528-85df-41bc-bf02-0f6da31fe6c1 req-915f316b-9b99-4f6f-ad89-e5e81d0dc18e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040928 Jul 29 14:39:12.773987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 221/449] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:39:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:35.495145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=13 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:35.495902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=42 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:35.500119 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:35.500618 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:35.506503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:35.506966 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:35.507736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:35.508175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:35.532333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b179443d-6b0d-4331-822a-88b334bbc53a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/ips" status: 200 len: 148 microversion: 2.1 time: 0.039129 Jul 29 14:39:35.532900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 229/450] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:39:35 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:35.628900 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-110fddee-a7b5-4e7e-8525-99d8385f426d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'create', calling method: .version_select at 0x7f681028e0d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2065034953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAfld9gC2vhtuKusS7ciH6LCDbpTT6Cg4IFjCzVgzryU9+4n+hozTDpbgjTwUgLKadjV6uqOvmDkkS0qHfgvctrVE8cv3t3FPspnHaBJHmRmupcjfL51pQBylgNp2zwsw=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:35.643611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=31 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:35.654180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-110fddee-a7b5-4e7e-8525-99d8385f426d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Getting quotas for project c5c24df7687b4e7093911f73e21b522a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:39:35.658086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-110fddee-a7b5-4e7e-8525-99d8385f426d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Getting quotas for user 3b3047e3ab2046c580e987a6518a4612 and project c5c24df7687b4e7093911f73e21b522a. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:39:35.772973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-110fddee-a7b5-4e7e-8525-99d8385f426d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.148865 Jul 29 14:39:35.774169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 222/451] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:39:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:35.880053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-112020653", "imageRef": "35887ce3-70a6-457d-81d0-cf16bc3648aa", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2065034953", "networks": [{"uuid": "5251e01e-cfac-4683-bfed-af6c20e0d82c"}]}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:35.934805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] validate_networks() for [('5251e01e-cfac-4683-bfed-af6c20e0d82c', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:39:36.329778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:39:36.330203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:39:36.330676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:39:36.331094 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:39:36.331506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:39:36.341161 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:36.341610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:36.342410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:36.342850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:36.360584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Getting quotas for project c5c24df7687b4e7093911f73e21b522a. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:39:36.364627 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Getting quotas for user 3b3047e3ab2046c580e987a6518a4612 and project c5c24df7687b4e7093911f73e21b522a. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:39:36.376001 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:39:36.378584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='35887ce3-70a6-457d-81d0-cf16bc3648aa',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:39:36.487558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8fe7f672-2b71-42ad-8051-e292d0b7a190 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.611916 Jul 29 14:39:36.488555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 230/452] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:39:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:39:36.499224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f165bd55-f822-4630-8d88-80022f2bd206 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:36.499961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f165bd55-f822-4630-8d88-80022f2bd206 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:36.574068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f165bd55-f822-4630-8d88-80022f2bd206 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:36.578902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f165bd55-f822-4630-8d88-80022f2bd206 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1258 microversion: 2.1 time: 0.083769 Jul 29 14:39:36.579478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 223/453] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:36 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:37.599842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f21c9784-9325-49b8-abd9-089d23913c82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:37.600601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f21c9784-9325-49b8-abd9-089d23913c82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:37.679475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f21c9784-9325-49b8-abd9-089d23913c82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:37.687510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f21c9784-9325-49b8-abd9-089d23913c82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1258 microversion: 2.1 time: 0.092008 Jul 29 14:39:37.701188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 231/454] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:37 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:38.467911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcefe0a0-b458-45d1-9f8d-07f79e398b82"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:38.470786 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:38.478449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:38.478911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:38.480119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:38.480756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:38.712926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:38.715117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:38.723639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:38.724431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:38.725574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:38.726393 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:38.825186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:38.834289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-81d33d6b-721e-461d-9b6c-a914f6c808ee tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1310 microversion: 2.1 time: 0.126171 Jul 29 14:39:38.835293 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 232/455] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:38 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1310 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:39.718254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7e797d4c-8215-4a99-a94a-7ca306111728 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.254253 Jul 29 14:39:39.721238 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 224/456] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:39:38 2022] POST /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments => generated 194 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:39.860206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:39.862285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:39.874621 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:39.875270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:39.877158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:39.878586 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:39.968256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:39.980505 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f5bb6722-1cd5-4496-aeb6-088977dbd2b4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1318 microversion: 2.1 time: 0.127659 Jul 29 14:39:39.982112 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 233/457] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:39 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1318 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:41.011393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:41.011393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:41.019244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:41.019918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:41.025393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:41.026323 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:41.342075 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:41.348150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-66d57ed1-0706-468d-81ca-b9db403fe180 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.349499 Jul 29 14:39:41.349245 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 225/458] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:40 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:42.025379 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-e82db83c-94a8-4ad6-8029-6519850242ed req-90aff8bc-7939-41c1-bf63-5fa2bf6de912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:42.044473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e82db83c-94a8-4ad6-8029-6519850242ed req-90aff8bc-7939-41c1-bf63-5fa2bf6de912 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:42.047045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e82db83c-94a8-4ad6-8029-6519850242ed req-90aff8bc-7939-41c1-bf63-5fa2bf6de912 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:42.073531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-e82db83c-94a8-4ad6-8029-6519850242ed req-90aff8bc-7939-41c1-bf63-5fa2bf6de912 service nova] Creating event network-changed:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:39:42.096257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-e82db83c-94a8-4ad6-8029-6519850242ed req-90aff8bc-7939-41c1-bf63-5fa2bf6de912 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073011 Jul 29 14:39:42.096912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 234/459] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:42.372293 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:42.373087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:42.385796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:42.386502 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:42.387433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:42.387928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:42.652707 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:42.667487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-58ce3d85-3e1d-4805-83ea-e720262b712c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.300683 Jul 29 14:39:42.668081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 226/460] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:42 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:43.087483 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:43.087996 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:43.094979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:43.095545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:43.096466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:43.096981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:43.134536 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8d20b730-c659-4553-928b-6ebc1624551f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/ips" status: 200 len: 152 microversion: 2.20 time: 0.052368 Jul 29 14:39:43.135295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 235/461] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Jul 29 14:39:43 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/ips => generated 152 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:39:43.688324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:43.688939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:43.697368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:43.697758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:43.699223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:43.699673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:43.976895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:43.980224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b01bb6fd-01aa-4c58-b461-62405d6b7467 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.296297 Jul 29 14:39:43.994249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 227/462] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:43 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:45.002423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:45.003992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:45.019156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:45.020028 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:45.021051 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:45.021505 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:45.203248 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:45.211407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4587033d-e388-4924-80a3-5989a79b61e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.212988 Jul 29 14:39:45.214969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 236/463] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:44 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:46.236232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:46.239589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:46.259157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:46.260122 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:46.261238 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:46.261892 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:46.450992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:46.463599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-df028a13-b2ab-49e9-9012-44435946782f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.232438 Jul 29 14:39:46.467610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 228/464] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:46 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:46.700597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:46.702091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:46.706398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:46.718673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:46.722317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:46.725186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:46.730988 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:46.761901 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lazy-loading 'flavor' on Instance uuid d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:39:47.490944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:47.493025 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:47.506002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:47.532727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:47.539032 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3cceb00e-aa31-4947-aa42-4a758c7e804e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/action" status: 202 len: 0 microversion: 2.20 time: 0.849260 Jul 29 14:39:47.540406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 237/465] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 14:39:46 2022] POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:39:47.542772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:47.543986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:47.544587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:47.561069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:47.562050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:47.568849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:47.569581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:47.570530 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:47.578322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:47.684883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=8 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:47.894490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:47.912665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:47.914270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:47.928197 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f458511a-39a8-48ac-bd0a-29fcef6157b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.383558 Jul 29 14:39:47.944831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 238/466] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:47 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:47.960569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:47.974108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-986fb194-b9c9-404c-b168-76cae7b86e82 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.490999 Jul 29 14:39:47.974686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 229/467] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:47 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:48.952232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:48.953617 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:48.960135 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:48.960583 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:48.961395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:48.962125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:49.006115 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:49.007353 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:49.026405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:49.040591 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:49.041714 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:49.042157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:49.172721 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:49.202113 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:49.205570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:49.207209 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-49a5f3ff-b3a0-4beb-b362-533982fee08b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.258964 Jul 29 14:39:49.209013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 239/468] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:48 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:49.377865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:49.387287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cb229222-4b6f-48f9-bbe4-18591a8cc7e4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.394855 Jul 29 14:39:49.387987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 230/469] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:48 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:50.231674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:50.232285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:50.246747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:50.247775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:50.249861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:50.250896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:50.412544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:50.413297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:50.440840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:50.444101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:50.457612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:50.458312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:50.518303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:50.527832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:50.529636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:50.535527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-89b96afb-4bc2-4393-bb96-c4942425f2d4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.303258 Jul 29 14:39:50.535527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 240/470] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:50 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:50.692585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:50.702555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef97925f-ffb2-40ee-9bcf-7788ce2b59f4 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.297514 Jul 29 14:39:50.717866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 231/471] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:50 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:51.209927 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-dafe91c4-121c-474d-8ad5-dc11f1e452f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Action: 'create', calling method: .version_select at 0x7f6810206550>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1345170100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHh18sbghi2H5mIp++csGYLIMlM0AVpuq+moccOBbVC0pNcD76ICkeSVSDlKTjkJoT0PsB69iBAU1IxroCCn4PsEjd1jm+o+d53tkYfi7yjN/8Pgz35K+Rje/8FWsLjU5g=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:51.225562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-dafe91c4-121c-474d-8ad5-dc11f1e452f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:39:51.229574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-dafe91c4-121c-474d-8ad5-dc11f1e452f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for user f9360a76354e4ae99668fe8debe4e7fb and project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:39:51.304509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-dafe91c4-121c-474d-8ad5-dc11f1e452f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.297626 Jul 29 14:39:51.306532 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 241/472] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:39:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:51.555613 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:51.556373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:51.563235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:51.563686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:51.564470 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:51.564910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:51.724170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:51.724779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:51.732222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:51.732672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:51.733469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:51.733900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:51.740812 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:51.750224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:51.751724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:51.752877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8c49aa81-9b7f-4811-8484-9cbabb8cee2e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.202004 Jul 29 14:39:51.754229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 232/473] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:51 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:51.920702 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:51.936542 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1cf3c54b-2fde-488a-9c22-b7928e2c0861 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.215640 Jul 29 14:39:51.948784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 242/474] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:51 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:39:52.218500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:52.223080 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:52.225183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.225638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:52.226410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.226879 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:52.257671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-56946c9f-8616-4fa2-912a-df69f57fddfd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/ips" status: 200 len: 145 microversion: 2.1 time: 0.043054 Jul 29 14:39:52.259108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 233/475] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:39:52 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:52.779575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:52.780287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:52.786799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.787334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:52.788346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.788742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:52.949716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:52.958272 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:52.962638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:52.962638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-668b350c-5220-440f-ab24-693c0170d680 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.185550 Jul 29 14:39:52.962638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 243/476] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:52 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:39:52.966432 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:52.967188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:52.977798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.981332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:52.982402 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:52.982933 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:53.224870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:53.233780 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c9099e77-3baf-47eb-a30c-542a8e834bb9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.272737 Jul 29 14:39:53.234469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 234/477] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:52 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:53.987672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:53.989159 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:53.995799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:53.996178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:53.997177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:53.997619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:54.193880 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:54.207298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:54.211876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:54.213492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1edc510e-d4c1-494c-aeb1-f109a140223d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.229449 Jul 29 14:39:54.214276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 244/478] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:53 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:54.255527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:54.256573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:54.263701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:54.264153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:54.265011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:54.265379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:54.408842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:54.417093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-534c85f6-d721-421e-9128-958b91e0993f tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.164873 Jul 29 14:39:54.417626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 235/479] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:54 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:55.238935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:55.245418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:55.247400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.247857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:55.248644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.249104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:55.394918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:55.404721 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:55.406492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:55.407658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-29779f9f-f176-4b4e-a9e2-0db265fa0a1d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.172922 Jul 29 14:39:55.408207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 245/480] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:55 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:55.438943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:55.439601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:55.446363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.446814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:55.448112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.448543 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:55.589277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:55.596840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cf6f038b-5c9b-4d85-8533-a87725acbe54 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.161696 Jul 29 14:39:55.597586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 236/481] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:55 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:55.852919 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b66232b-3532-4449-b317-01c3c7061a7c"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:55.855759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:55.861834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.862277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:55.863034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:55.863462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:56.431063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:56.432537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:56.439119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:56.439819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:56.440583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:56.441039 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:56.824371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:56.832274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:56.833802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:56.835008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e1be6ef7-647b-41ef-82dc-a8486a9fcdf4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.408236 Jul 29 14:39:56.835557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 237/482] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:56 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:39:56.840421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:56.841055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:56.846770 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:56.847229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:56.848010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:56.848452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:56.983363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:56.991003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-08d2301f-9536-448b-a8ec-c6ef4216174b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.154478 Jul 29 14:39:56.991697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 238/483] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:56 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:57.858833 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:57.859475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:57.861153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:57.867233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:57.870459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:57.870459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:57.870459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:57.888768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:39:58.002669 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:58.012366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:58.013857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:58.015012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bee86d64-66a4-4495-938a-2cc32e0c2fe4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.160052 Jul 29 14:39:58.015568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 239/484] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:57 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:39:58.019991 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:58.020595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:58.026999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:58.027461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:58.028230 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:58.028946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:58.035600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-87725a83-bd21-494d-98f3-977a3527857c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.186340 Jul 29 14:39:58.036676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 246/485] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:39:55 2022] POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments => generated 194 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:39:58.256186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:58.275236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cac8d9ca-619a-4cbd-9fcf-18abc03ec90b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.258468 Jul 29 14:39:58.278391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 240/486] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:58 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:59.045290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:59.049465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:59.060042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:59.060613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:59.061921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:59.062435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:59.243048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:59.252462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:59.254080 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:59.255266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-60310e70-1172-45b3-84d7-2398262d5c24 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.215329 Jul 29 14:39:59.256184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 247/487] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:39:59 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:39:59.303424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:39:59.304397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:39:59.311626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:59.312160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:59.312927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:39:59.313393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:39:59.446487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:39:59.454130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-90e5571c-071c-4f9d-a2a8-667d769c6c72 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.154514 Jul 29 14:39:59.454876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 241/488] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:39:59 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:39:59.601903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d7aefbe7-52c5-4632-afc5-062afd9f873c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: .version_select at 0x7f68101f0ee0>, body: {"keypair": {"name": "tempest-keypair-942758086", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFAfFGq0EY/YWtLTVCqAgJQCu4VLU9MbOsf/4aeVua10DYWTFqwFvgGcnZMPAJDbjYqf11G94ehsTs4FPzh45KgI4oipi3mVJjvOdVLP+kyf753fgzgIdrvNsEkMGQvGg=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:39:59.618246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-d7aefbe7-52c5-4632-afc5-062afd9f873c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:39:59.622667 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-d7aefbe7-52c5-4632-afc5-062afd9f873c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:39:59.698062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d7aefbe7-52c5-4632-afc5-062afd9f873c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.099880 Jul 29 14:39:59.698656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 248/489] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:39:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:00.303185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:00.303185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:00.303185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:00.303185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:00.303516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:00.303516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:00.456429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:00.467385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:00.469033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:00.470210 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c4cd2aff-1b41-4b80-bbf1-9af48db6e0e0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.194557 Jul 29 14:40:00.470790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 242/490] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:00 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:00.474833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:00.475450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:00.482339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:00.482784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:00.483546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:00.483979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:00.627759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:00.640208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9b8710db-9d8c-4202-aabc-996b0c3f7844 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.169580 Jul 29 14:40:00.640826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 249/491] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:00 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:01.494251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:01.494921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:01.501978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:01.502431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:01.503249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:01.503677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:01.657523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:01.661818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:01.663121 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:01.669641 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:01.670876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:01.671144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:01.671331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:01.672118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:01.672324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-df7cdc2d-d1c7-4bd0-a21e-3d4d18a6c9a1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.182060 Jul 29 14:40:01.672560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:01.672881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 243/492] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:01 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:01.808856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:01.816629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9f9b2e32-abb2-4e2f-8a31-95d3fe01c7b9 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.158874 Jul 29 14:40:01.817239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 250/493] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:01 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:02.696673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:02.697342 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:02.705364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:02.707888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:02.707888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:02.707888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:02.837847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:02.838449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:02.845879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:02.846419 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:02.847099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:02.847846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:02.936164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:02.944221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:02.948871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:02.948871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-42cb7678-c11d-4453-92c9-26a3b181f7c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.254896 Jul 29 14:40:02.948871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 244/494] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:02 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:02.986139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:02.993899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6c722032-e63d-4a35-b3f9-7973b303bd07 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.159926 Jul 29 14:40:02.999645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 251/495] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:02 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:03.522700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1111610534", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b59a034-1f9b-4894-a9bb-b8f2d507494e"}], "security_groups": [{"name": "tempest-securitygroup--1665206816"}], "key_name": "tempest-keypair-942758086", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:03.630454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] validate_networks() for [('5b59a034-1f9b-4894-a9bb-b8f2d507494e', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:40:03.971021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:03.971638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:03.978100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:03.978558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:03.979436 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:03.980390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.008341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:40:04.008341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:40:04.008341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:40:04.008341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:40:04.009081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:40:04.019136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:04.019588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.020399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:04.021084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.038974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:40:04.044155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:40:04.055734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:40:04.059161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:40:04.113845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:04.122413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:04.123909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:04.125076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5b38ec10-9e48-42b7-9580-6a8bbfa8a6d7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.158017 Jul 29 14:40:04.125625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 252/496] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:03 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:04.130117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:04.130791 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:04.137748 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:04.141588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.141588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:04.141588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.231344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9960258e-6204-45cd-87fa-7468e47244ec tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.712716 Jul 29 14:40:04.235641 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 245/497] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:40:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:40:04.242701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a16a1745-27f0-46df-b1c7-4e31f53aa20f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:04.243383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a16a1745-27f0-46df-b1c7-4e31f53aa20f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:04.288798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:04.296843 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f0a1e4ae-c8e1-44db-8ce3-c83e23de8e18 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.170228 Jul 29 14:40:04.297442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 253/498] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:04 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:04.308894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a16a1745-27f0-46df-b1c7-4e31f53aa20f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:04.316409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a16a1745-27f0-46df-b1c7-4e31f53aa20f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1241 microversion: 2.1 time: 0.077244 Jul 29 14:40:04.316771 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 246/499] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:04 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:04.714757 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-421ce919-002b-41db-b61f-3408cd42e25e req-014ef70d-9302-4a15-b054-4e06c392b03f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "name": "network-vif-plugged", "status": "completed", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:04.724560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-421ce919-002b-41db-b61f-3408cd42e25e req-014ef70d-9302-4a15-b054-4e06c392b03f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:04.725254 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-421ce919-002b-41db-b61f-3408cd42e25e req-014ef70d-9302-4a15-b054-4e06c392b03f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:04.736465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-421ce919-002b-41db-b61f-3408cd42e25e req-014ef70d-9302-4a15-b054-4e06c392b03f service nova] Creating event network-vif-plugged:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:40:04.741538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-421ce919-002b-41db-b61f-3408cd42e25e req-014ef70d-9302-4a15-b054-4e06c392b03f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031749 Jul 29 14:40:04.742246 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 254/500] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:05.149562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:05.150759 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:05.159601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.160317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.161294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.161947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.319142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:05.319839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:05.319943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:05.326662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.327119 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.327902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.328340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.328866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:05.330434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:05.331622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6579dd26-5095-4f23-9a25-858245f14249 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.186057 Jul 29 14:40:05.332445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 247/501] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:05 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:05.336902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:05.337540 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:05.344408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.344862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.345668 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:05.346106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:05.410743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:05.418794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-251a867c-31af-4307-a2b7-7d67f0c907b1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1245 microversion: 2.1 time: 0.085368 Jul 29 14:40:05.419370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 248/502] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:05 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:05.468464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:05.475876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1963a24c-23a9-4d58-8acb-81d7014bad90 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.161415 Jul 29 14:40:05.476434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 255/503] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:05 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:06.356113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:06.356795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:06.359081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:06.363799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.364246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.365028 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.365464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.441242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:06.441716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:06.445325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:06.450496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.450946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.451809 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.452247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.493690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:06.502435 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:06.504048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:06.505341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5960a875-7c6b-42ba-9e60-8cad2b05ab7b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.153755 Jul 29 14:40:06.506011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 249/504] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:06 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:06.514324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:06.515003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:06.521482 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.522008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.522128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:06.522936 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:06.523454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:06.530623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b4cdd537-58cf-4ead-9138-36edc367573b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1237 microversion: 2.1 time: 0.094514 Jul 29 14:40:06.531191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 256/505] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:06 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1237 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:06.666918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:06.674595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f715e2eb-734b-4cc5-ab57-edd08dc3dced tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1358 microversion: 2.1 time: 0.167448 Jul 29 14:40:06.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 250/506] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:06 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:07.527692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:07.528298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:07.534882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.535329 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.536090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.536526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.551638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:07.554099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:07.559757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.560214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.561014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.561461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.625732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:07.633155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c6775450-10ff-4985-b5fd-92156e1f3ed2 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1293 microversion: 2.1 time: 0.085314 Jul 29 14:40:07.633729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 251/507] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:07 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:07.665545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:07.674154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:07.675935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:07.677128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e642dce2-02b3-4c6e-b239-173697df1702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.153420 Jul 29 14:40:07.677684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 257/508] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:07 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:07.696214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:07.696927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:07.704102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.704678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.705692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.710451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.832443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:07.840196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9edcdc1d-15c6-4c67-bb36-5532ef61fc6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1548 microversion: 2.1 time: 0.147408 Jul 29 14:40:07.840751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 252/509] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:07 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:07.860276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:07.860884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:07.866839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.867283 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:07.868038 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:07.868468 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.000980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.008619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-fb987a1a-0172-4c8b-aed0-49a1d2b970fe tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1548 microversion: 2.1 time: 0.152706 Jul 29 14:40:08.009220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 258/510] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:07 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:08.028638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:08.033447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.034212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Searching by: {'deleted': False, 'project_id': 'c5c24df7687b4e7093911f73e21b522a'} {{(pid=124771) get_all /opt/stack/nova/nova/compute/api.py:2964}} Jul 29 14:40:08.041013 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.041486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.042289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.043424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.134048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.multi_cell_list [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124771) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 29 14:40:08.227409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-af1b3913-f9f8-4ac4-9418-e3883816af50 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.203197 Jul 29 14:40:08.227916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 253/511] 10.222.0.49 () {58 vars in 1125 bytes} [Fri Jul 29 14:40:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:08.239294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:08.239910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:08.246097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.246633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.247400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.247838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.383673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.391858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-81884f9a-c2c3-40c2-baba-0c6037bf95e2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1548 microversion: 2.1 time: 0.156390 Jul 29 14:40:08.392424 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 259/512] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:08 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:08.653465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:08.654102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:08.660186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.660713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.661811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.662258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.701583 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:08.702191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:08.708952 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.709469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.710244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:08.710674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:08.728490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.737523 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-633149a7-5ed1-4d04-b5c7-50dde22ddcc7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1301 microversion: 2.1 time: 0.088058 Jul 29 14:40:08.738756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 254/513] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:08 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:08.850724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.859450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.860954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:08.862135 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-285733f1-d3c1-46ec-980f-f07e86a999b4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.165239 Jul 29 14:40:08.862689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 260/514] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:08 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:09.762585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:09.763194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:09.769643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:09.770103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:09.770898 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:09.771310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:09.836364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:09.845144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ab70920c-ab00-40c9-86cc-673a465e8745 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1311 microversion: 2.1 time: 0.086775 Jul 29 14:40:09.846105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 255/515] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:09 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:09.887648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:09.888804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:09.890902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=8 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:09.913221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:09.913221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:09.913221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:09.913221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:10.043407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:10.051324 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:10.052855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:10.054304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-59c9c3a2-ab49-4cd5-9211-11b3b5c88cb3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.172104 Jul 29 14:40:10.054855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 261/516] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:09 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:10.866916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:10.867519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:10.877698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:10.878287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:10.878910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:10.879341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.004527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-94c69f53-522b-42d4-a64b-55987010d979 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:11.011146 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c69f53-522b-42d4-a64b-55987010d979 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.011673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94c69f53-522b-42d4-a64b-55987010d979 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.074801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-94c69f53-522b-42d4-a64b-55987010d979 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Going to try to stop instance {{(pid=124772) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 14:40:11.113117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:11.120586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-be192244-db85-485c-b286-55f723421793 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.257453 Jul 29 14:40:11.121219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 256/517] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:10 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:11.125694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:11.126300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:11.132009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.132654 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.133476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.134071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.165173 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:11.265649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-94c69f53-522b-42d4-a64b-55987010d979 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action" status: 202 len: 0 microversion: 2.1 time: 0.264635 Jul 29 14:40:11.269580 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 262/518] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:40:10 2022] POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 14:40:11.279765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:11.280700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:11.290096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.291605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.291716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.292232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.298532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:11.307033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:11.308700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:11.309953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-60210dc3-8f9b-4051-92da-eae6016c0c94 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.187826 Jul 29 14:40:11.310692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 257/519] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:11 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:11.319927 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:11.384308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-2135bd9e-a111-4645-a2fd-75434c1f5f57 req-87887e0f-00bc-4062-9bcb-c8427cf5fdde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b03f71-e979-45c1-a50f-40bbb4ef2bad", "tag": "7060ed6b-4d5a-4aaa-8f19-12fac0218ffd"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:11.399410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-2135bd9e-a111-4645-a2fd-75434c1f5f57 req-87887e0f-00bc-4062-9bcb-c8427cf5fdde service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.399983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-2135bd9e-a111-4645-a2fd-75434c1f5f57 req-87887e0f-00bc-4062-9bcb-c8427cf5fdde service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.419451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-2135bd9e-a111-4645-a2fd-75434c1f5f57 req-87887e0f-00bc-4062-9bcb-c8427cf5fdde service nova] Creating event network-changed:7060ed6b-4d5a-4aaa-8f19-12fac0218ffd for instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad on hv-cinder-79987 Jul 29 14:40:11.424794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-2135bd9e-a111-4645-a2fd-75434c1f5f57 req-87887e0f-00bc-4062-9bcb-c8427cf5fdde service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050534 Jul 29 14:40:11.425533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 258/520] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:11.431447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04236799-ae50-4e1c-b79d-7aa26e9bccda"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:11.434407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:11.440674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.441181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.442008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:11.442460 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:11.451543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:11.460450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4ee3572e-805c-491d-bf84-e4b14c1c90f9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.185818 Jul 29 14:40:11.462085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 263/521] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:11 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:12.141238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:12.141946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:12.149640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.150531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.151102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.151516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.286992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:12.296404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bdb9b13c-c707-4eab-a8f3-a8bf75bb4c2f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.158862 Jul 29 14:40:12.299831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 264/522] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:12 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:12.323359 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a3fb5c0e-3ad4-49ed-9ef0-6f96fce5e31b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.896331 Jul 29 14:40:12.324657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 259/523] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:40:11 2022] POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:12.334217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:12.334817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:12.342899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.343349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.344344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.344785 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.490837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:12.491545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:12.501188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:12.508438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.508938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.509766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:12.510207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:12.520281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:12.522350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:12.523761 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2470bf98-9ab6-4b4a-b276-3718bdc8215e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.193792 Jul 29 14:40:12.524790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 265/524] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:12 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:12.691409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:12.699798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8b63682-7c1e-4956-8a79-03bb2832dc03 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.219052 Jul 29 14:40:12.702990 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 260/525] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:12 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:13.318439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:13.318969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:13.325420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.325873 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.326642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.327077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.461603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:13.469020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-59f8a17f-ca44-402b-87fe-38f7db3c603e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.154505 Jul 29 14:40:13.469595 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 266/526] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:13 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:13.547975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:13.548578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:13.555216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.555661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.556417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.556851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.681664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:13.690191 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:13.691694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:13.692843 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-647c9f6e-b855-46af-9246-56da41449736 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.148817 Jul 29 14:40:13.693427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 261/527] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:13 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:13.721501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:13.722102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:13.727926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.728370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.729155 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:13.729587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:13.860489 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:13.868242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d62a9139-3f67-4726-946e-bf010031d0d8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.150470 Jul 29 14:40:13.868797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 267/528] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:13 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:14.490012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:14.490749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:14.492743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=8 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:14.497806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.498295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:14.499198 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.499637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:14.627324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:14.634689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f5072ab3-4be9-47a2-8639-b9b26d8dc117 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.148482 Jul 29 14:40:14.635256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 262/529] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:14 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:14.716326 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:14.716935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:14.723413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.723869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:14.724643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.725120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:14.851163 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:14.859141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:14.860676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:14.861930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e8e760b3-2e50-49bf-8c75-f2b1fe18d85a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.150238 Jul 29 14:40:14.862478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 268/530] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:14 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:14.890062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:14.890607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:14.896602 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.897077 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:14.897847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:14.898282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:15.028527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:15.036377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-77f5ddde-1712-4510-928a-44611f558aa5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.151068 Jul 29 14:40:15.036956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 263/531] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:14 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:15.654832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:15.655438 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:15.661457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:15.661906 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:15.662664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:15.663100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:15.790338 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:15.798357 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1ccb1a28-fd32-4c9a-ad73-ed69c6ca2d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.147402 Jul 29 14:40:15.798911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 269/532] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:15 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:15.884449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:15.885083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:15.891772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:15.892213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:15.892975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:15.893437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:16.024630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:16.033350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:16.034863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:16.038219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-807622be-7c22-46d0-b2e2-f294a73460f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.155563 Jul 29 14:40:16.038219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 264/533] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:15 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:16.057735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:16.068524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:16.068524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:16.068524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:16.068524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:16.068930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:16.192733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:16.200649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad33ad53-45ed-40fb-85dc-9a8bdd475003 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.147074 Jul 29 14:40:16.201244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 270/534] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:16 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:16.819790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:16.820418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:16.827168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:16.827620 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:16.828390 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:16.828829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:16.955111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:16.962635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aa40b165-6631-4e63-aa6a-8a42b655b21a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.146813 Jul 29 14:40:16.963235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 265/535] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:16 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:17.060829 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:17.061521 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:17.067982 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.075005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:17.075005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.075005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:17.196083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:17.204159 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:17.205893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:17.207045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c4f05285-1de8-4fd3-b1a4-a9e03916c083 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.150807 Jul 29 14:40:17.207611 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 271/536] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:17 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:17.221753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:17.222362 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:17.228285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.228731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:17.229529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.229967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:17.356524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:17.364343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dfa58979-47d5-4018-b0c5-4b0a6de602b0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.146457 Jul 29 14:40:17.364902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 266/537] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:17 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:17.983674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:17.984292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:17.990478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.990930 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:17.991698 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:17.992137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:18.122817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:18.130201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7b712c26-a1d4-49af-b970-1c8fb0002389 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.150607 Jul 29 14:40:18.130756 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 272/538] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:17 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:18.229965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:18.230642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:18.232963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:18.237832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:18.238280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:18.239040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:18.239475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:18.370140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:18.378607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:18.380152 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:18.381411 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3c3619d-2b6a-442d-b60b-fe11ae0158cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.155281 Jul 29 14:40:18.381978 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 267/539] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:18 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:18.386338 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:18.387498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:18.393451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:18.393905 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:18.394673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:18.395111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:18.524469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:18.532771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-12941a22-e6fd-43b3-a5a5-74e86d99ec41 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.150232 Jul 29 14:40:18.533360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 273/540] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:18 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:19.151453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:19.152084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:19.158552 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.159002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.159773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.160214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.294897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:19.302093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1cf767b9-0457-44ed-bab0-b51339b4b7c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.154498 Jul 29 14:40:19.302645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 268/541] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:19 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:19.405599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:19.406135 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:19.412585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.413086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.413845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.414274 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.552659 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:19.554180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:19.554826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:19.560969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.561520 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.561649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:19.562297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:19.562733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:19.563118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:19.564300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8b7ba535-e0ea-4579-94d5-0350c762868a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.163329 Jul 29 14:40:19.565082 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 274/542] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:19 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:19.693297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:19.702023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7b8ebef1-854a-4b00-a7dd-9b976b6503fa tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.151894 Jul 29 14:40:19.702621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 269/543] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:19 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:20.140203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-6f49cc79-14c7-429f-b4a7-902011ea6311 req-9e6ef8bb-57ed-4791-bd95-d3db464fbd59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b03f71-e979-45c1-a50f-40bbb4ef2bad", "name": "network-vif-plugged", "status": "completed", "tag": "7060ed6b-4d5a-4aaa-8f19-12fac0218ffd"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:20.149741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-6f49cc79-14c7-429f-b4a7-902011ea6311 req-9e6ef8bb-57ed-4791-bd95-d3db464fbd59 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.150184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-6f49cc79-14c7-429f-b4a7-902011ea6311 req-9e6ef8bb-57ed-4791-bd95-d3db464fbd59 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.162282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-6f49cc79-14c7-429f-b4a7-902011ea6311 req-9e6ef8bb-57ed-4791-bd95-d3db464fbd59 service nova] Creating event network-vif-plugged:7060ed6b-4d5a-4aaa-8f19-12fac0218ffd for instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad on hv-cinder-79987 Jul 29 14:40:20.167479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-6f49cc79-14c7-429f-b4a7-902011ea6311 req-9e6ef8bb-57ed-4791-bd95-d3db464fbd59 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032059 Jul 29 14:40:20.168277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 275/544] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:20.323644 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:20.325065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:20.331766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.332217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.332983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.333443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.462023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:20.470137 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9082b18e-a554-48f4-95e7-4bf2fe50e518 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.150314 Jul 29 14:40:20.470705 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 270/545] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:20 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:20.562384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1904619278", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345170100", "security_groups": [{"name": "tempest-secgroup-smoke-67867029"}], "block_device_mapping_v2": [{"uuid": "0af0ffcb-c99d-44fa-9886-ef17a341bdb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16aee007-d69b-4d84-b034-615cf90e91d9"}]}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:20.587412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:20.588317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:20.597278 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.597731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.598605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.599068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.679213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] validate_networks() for [('16aee007-d69b-4d84-b034-615cf90e91d9', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:40:20.733325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:20.741881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:20.743495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:20.744713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a98b9a54-7654-432f-9ff1-c00c8633b808 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.161254 Jul 29 14:40:20.745389 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 271/546] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:20 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:20.750624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:20.751297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:20.757360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.757919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.758745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:20.759243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:20.891857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:20.900014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b08ca784-6f09-4e10-afcb-c40e8822bcf4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.153571 Jul 29 14:40:20.902894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 272/547] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:20 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:21.057744 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:40:21.058167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:40:21.058639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:40:21.059136 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:40:21.059548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:40:21.068423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.068870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.069699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.070135 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.086985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:40:21.091726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for user f9360a76354e4ae99668fe8debe4e7fb and project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:40:21.148344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:40:21.150591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0af0ffcb-c99d-44fa-9886-ef17a341bdb3',volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:40:21.491771 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:21.492373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:21.499314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.499760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.500565 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.501011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.519299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:21.547142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7ea1dd94-78ef-4c78-ad01-78d5352849e5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.990110 Jul 29 14:40:21.548034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 276/548] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:40:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 992 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:40:21.558769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f94dea6d-a9bb-4238-8e4a-f871c4b64c2b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:21.560425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f94dea6d-a9bb-4238-8e4a-f871c4b64c2b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:21.619044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f94dea6d-a9bb-4238-8e4a-f871c4b64c2b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:21.626518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f94dea6d-a9bb-4238-8e4a-f871c4b64c2b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1095 microversion: 2.1 time: 0.071534 Jul 29 14:40:21.627170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 277/549] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:21 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:21.641202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:21.648950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-038dcf0f-67fd-4074-b366-569b73bff3a9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.161062 Jul 29 14:40:21.649552 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 273/550] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:21 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:21.767770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:21.768376 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:21.775196 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.775644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.776394 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.776849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.911722 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:21.922961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:21.923842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:21.931078 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.934521 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:21.935070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.935945 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:21.937564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:21.939175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:21.943257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-42d7fa44-5909-484a-9de2-634719cb4f76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.179364 Jul 29 14:40:21.943825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 278/551] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:21 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:22.069462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:22.078722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b4871fbf-a655-4cf9-87b4-01e1405f4aa8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.160542 Jul 29 14:40:22.079296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 274/552] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:21 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:22.647113 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:22.647730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:22.655023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.655475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:22.656244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.656683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:22.670350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:22.670961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:22.677708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.678153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:22.684869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.684869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:22.717910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:22.725411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-858d3ab9-fafb-4498-b065-0c79e5e4ddab tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1145 microversion: 2.1 time: 0.082176 Jul 29 14:40:22.725985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 279/553] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:22 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:22.812500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:22.819827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-365a8d49-0e7f-40ee-9619-89685457e394 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1367 microversion: 2.1 time: 0.154610 Jul 29 14:40:22.820382 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 275/554] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:22 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:22.971910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:22.973609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:22.982206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.982671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:22.983497 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:22.983984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.100287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:23.101012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:23.108233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.108684 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.109511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.110187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.120364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.129410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.130946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.132097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2754b61f-5705-4e8e-a3f8-ed19a34c5a07 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.168113 Jul 29 14:40:23.132655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 280/555] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:22 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:23.252143 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.259999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bdd74ba6-333c-4e01-9f24-29291700e24b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.163872 Jul 29 14:40:23.260549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 276/556] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:23 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:23.747124 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:23.747741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:23.754627 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.755074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.755842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.756305 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.817349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.825669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2f92127d-a992-4019-acdb-eddcc85b5058 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1145 microversion: 2.1 time: 0.082476 Jul 29 14:40:23.826238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 281/557] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:23 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:23.841104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:23.841793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:23.848550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.849019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.849864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.850364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.968749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-c47e13bc-e990-427b-a9ef-e4444f029947 req-0ffa6300-1ce4-40a8-95ac-b38ae6faf49c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "name": "network-vif-plugged", "status": "completed", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:23.979479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c47e13bc-e990-427b-a9ef-e4444f029947 req-0ffa6300-1ce4-40a8-95ac-b38ae6faf49c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:23.979479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c47e13bc-e990-427b-a9ef-e4444f029947 req-0ffa6300-1ce4-40a8-95ac-b38ae6faf49c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:23.990020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-c47e13bc-e990-427b-a9ef-e4444f029947 req-0ffa6300-1ce4-40a8-95ac-b38ae6faf49c service nova] Creating event network-vif-plugged:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:40:23.990863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:23.995546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-c47e13bc-e990-427b-a9ef-e4444f029947 req-0ffa6300-1ce4-40a8-95ac-b38ae6faf49c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031149 Jul 29 14:40:23.996373 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 282/558] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:23.999639 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c38fc122-e691-4299-84f1-f5853a0faaba tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1556 microversion: 2.1 time: 0.162937 Jul 29 14:40:24.000219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 277/559] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:23 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:24.022491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:24.025433 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:24.029898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.030351 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.031115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.031583 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.035335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:24.113719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-23612d46-2d44-489c-87b2-176c0926552d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095691 Jul 29 14:40:24.114334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 283/560] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:40:24 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:40:24.156104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:24.156735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:24.162755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.163209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.163986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.164420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.281764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:24.282396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:24.288693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.289211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.290004 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.290448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.302997 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:24.312972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:24.314877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:24.316194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-18eb5171-ef3b-4522-ac11-64edcffc5214 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.164693 Jul 29 14:40:24.321045 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 278/561] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:24 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:24.639259 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:24.647329 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b888a7e9-002d-42a6-a0cb-1073295dbddf tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.369739 Jul 29 14:40:24.647901 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 284/562] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:24 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:24.846081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:24.846687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:24.853245 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.853704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.854471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:24.854907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:24.920917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:24.928692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d5066cda-89ec-41c1-8a89-7b8b5d6a3fc5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1137 microversion: 2.1 time: 0.086180 Jul 29 14:40:24.929312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 279/563] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:24 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:25.340392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:25.341005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:25.347459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.347912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.348691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.349173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.442138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-4c1acc03-e0dc-4556-a3ad-3045185dd81a req-5ba48f93-6bc9-448a-be42-277ff8e1ff65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1b03f71-e979-45c1-a50f-40bbb4ef2bad", "tag": "7060ed6b-4d5a-4aaa-8f19-12fac0218ffd"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:25.453288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4c1acc03-e0dc-4556-a3ad-3045185dd81a req-5ba48f93-6bc9-448a-be42-277ff8e1ff65 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.453743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4c1acc03-e0dc-4556-a3ad-3045185dd81a req-5ba48f93-6bc9-448a-be42-277ff8e1ff65 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.464869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-4c1acc03-e0dc-4556-a3ad-3045185dd81a req-5ba48f93-6bc9-448a-be42-277ff8e1ff65 service nova] Creating event network-changed:7060ed6b-4d5a-4aaa-8f19-12fac0218ffd for instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad on hv-cinder-79987 Jul 29 14:40:25.471564 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-4c1acc03-e0dc-4556-a3ad-3045185dd81a req-5ba48f93-6bc9-448a-be42-277ff8e1ff65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032960 Jul 29 14:40:25.472465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 280/564] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:25.504860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:25.513618 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:25.515260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:25.516515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1634ea57-9eb8-4bf2-aa3d-831a00edd061 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.180285 Jul 29 14:40:25.517644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 285/565] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:25 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:25.669950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:25.670634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:25.677260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.677725 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.678897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.679576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.859655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:25.867672 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d64fb39c-1362-446e-815e-4727ab5f5df4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.201955 Jul 29 14:40:25.868310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 281/566] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:25 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:25.952508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:25.953057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:25.959063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.959515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:25.960281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:25.960720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:26.024514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:26.032214 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d663001f-7d07-4464-8495-d93ea898b39f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1193 microversion: 2.1 time: 0.084281 Jul 29 14:40:26.032924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 286/567] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:25 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1193 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:26.540971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:26.542045 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:26.548588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:26.549510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:26.550496 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:26.550937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:26.733695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:26.741434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:26.742949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:26.744104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75f234eb-66f0-463e-bca8-e62764f3838b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1745 microversion: 2.20 time: 0.207412 Jul 29 14:40:26.744654 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 282/568] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:26 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1745 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:26.889855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:26.890675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:26.897692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:26.899321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:26.900320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:26.900766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.046561 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:27.054047 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:27.054814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:27.056339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-21a6e388-3373-4afe-bbbc-0e21312b1a4b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1724 microversion: 2.1 time: 0.170253 Jul 29 14:40:27.056923 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 287/569] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:26 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:27.061647 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.062106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.067071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.067071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.142827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:27.150258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e494d842-9c03-467e-8d17-b19492fd414e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1211 microversion: 2.1 time: 0.100230 Jul 29 14:40:27.151054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 283/570] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:27 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1211 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:27.367438 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:27.368138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:27.374670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.375207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.376042 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.376528 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.526688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:27.537947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c6c142a8-76aa-4466-a139-e3d027b89850 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1594 microversion: 2.1 time: 0.172723 Jul 29 14:40:27.537947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 288/571] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:27 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1594 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:27.770596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:27.770596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:27.777754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.778678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:27.780367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:27.781080 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.082097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:28.083460 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:28.096407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:28.104058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.105214 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.106877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.107803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.113621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:28.118342 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:28.119898 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1a43be4c-32ba-47d7-81f8-e2e709003965 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.356005 Jul 29 14:40:28.120932 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 284/572] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:27 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:28.176275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:28.177178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:28.185456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.186136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.193387 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.193387 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.397116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:28.409629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1058a7c7-4355-4c52-9ba8-0d227012d363 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1701 microversion: 2.1 time: 0.333299 Jul 29 14:40:28.411829 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 289/573] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:28 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1701 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:28.443444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6809baf8-1b95-4456-a2ff-992ac37fb451 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:28.461537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6809baf8-1b95-4456-a2ff-992ac37fb451 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.462273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6809baf8-1b95-4456-a2ff-992ac37fb451 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.502481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6809baf8-1b95-4456-a2ff-992ac37fb451 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Going to try to start instance {{(pid=124772) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 14:40:28.507457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:28.533028 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-60de7467-c7df-4bd5-9867-e7b0f9b00be4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1277 microversion: 2.1 time: 0.350957 Jul 29 14:40:28.534280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 285/574] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:28 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1277 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:28.888111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6809baf8-1b95-4456-a2ff-992ac37fb451 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action" status: 202 len: 0 microversion: 2.1 time: 0.454438 Jul 29 14:40:28.889518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 290/575] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:40:28 2022] POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:40:28.901348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:28.901796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:28.916461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.920857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:28.922048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:28.924040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.146230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:29.147878 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:29.157039 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:29.158474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.159800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:29.160701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.218806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:29.228851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3c21f020-0e78-48d4-a438-201f118f02e4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1710 microversion: 2.1 time: 0.333129 Jul 29 14:40:29.230085 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 286/576] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:28 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1710 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:29.327140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-a66a28ef-97dd-4972-aa71-40fc9d54a335 req-f30d5cc8-1143-42a1-b56a-a7aaaa2ba5a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275089c-3a8d-4785-9bea-bfa300e57580", "tag": "b09d2a6b-fd57-4a55-a66e-36abbc1e72c7"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:29.341708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-a66a28ef-97dd-4972-aa71-40fc9d54a335 req-f30d5cc8-1143-42a1-b56a-a7aaaa2ba5a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:29.347785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-a66a28ef-97dd-4972-aa71-40fc9d54a335 req-f30d5cc8-1143-42a1-b56a-a7aaaa2ba5a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.366956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-a66a28ef-97dd-4972-aa71-40fc9d54a335 req-f30d5cc8-1143-42a1-b56a-a7aaaa2ba5a1 service nova] Creating event network-changed:b09d2a6b-fd57-4a55-a66e-36abbc1e72c7 for instance 6275089c-3a8d-4785-9bea-bfa300e57580 on hv-cinder-79987 Jul 29 14:40:29.378891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-a66a28ef-97dd-4972-aa71-40fc9d54a335 req-f30d5cc8-1143-42a1-b56a-a7aaaa2ba5a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058910 Jul 29 14:40:29.382154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 287/577] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:40:29.482500 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:29.513191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:29.516551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:29.520158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6a4ef15e-f42d-4611-872c-3771510b4a7a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.379236 Jul 29 14:40:29.539474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 291/578] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:29 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:29.547671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:29.548369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:29.565619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:29.566172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.567004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:29.576046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:29.931323 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:29.939369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f72b6776-5b03-494d-a145-50558e87857d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.396362 Jul 29 14:40:29.953407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 288/579] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:29 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:30.254196 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:30.254805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:30.269493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.270266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:30.271271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.271862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:30.548727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:30.550576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:30.569774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.570546 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:30.571876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.572467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:30.762686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:30.776967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:30.779814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:30.781295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5c046ea1-ecda-44ec-8f59-3432ff9bd935 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.237127 Jul 29 14:40:30.800789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 289/580] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:30 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:30.815786 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:30.825428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-87965514-d043-4456-a922-f8b9df07db49 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1710 microversion: 2.1 time: 0.575520 Jul 29 14:40:30.826673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 292/581] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:30 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1710 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:30.966936 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:30.967550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:30.984601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.990795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:30.991994 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:30.994035 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.207327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-ab3a091f-1d7a-4ccd-83a7-3bef0c0f3515 req-2736e1b7-a12c-4ba4-85bd-af88b1fc5209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:31.212793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:31.224365 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ab3a091f-1d7a-4ccd-83a7-3bef0c0f3515 req-2736e1b7-a12c-4ba4-85bd-af88b1fc5209 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:31.224808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ab3a091f-1d7a-4ccd-83a7-3bef0c0f3515 req-2736e1b7-a12c-4ba4-85bd-af88b1fc5209 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.259509 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:31.262620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-ab3a091f-1d7a-4ccd-83a7-3bef0c0f3515 req-2736e1b7-a12c-4ba4-85bd-af88b1fc5209 service nova] Creating event network-changed:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:40:31.268028 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-ab3a091f-1d7a-4ccd-83a7-3bef0c0f3515 req-2736e1b7-a12c-4ba4-85bd-af88b1fc5209 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064343 Jul 29 14:40:31.272045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 293/582] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:31.277645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-71cab5df-ca63-4381-879d-391da636fecb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.314377 Jul 29 14:40:31.291014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 290/583] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:30 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:31.810537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:31.811243 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:31.813797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=8 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:31.819364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:31.819814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.822736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:31.823184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.846799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:31.847718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:31.854610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:31.855182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.856381 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:31.856927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:31.876679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:31.975690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:31.984107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:31.985700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:31.986936 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-871d2bb6-39ff-47c6-9f28-74d50038efef tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.182660 Jul 29 14:40:31.989036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 294/584] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:31 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:32.014076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:32.022210 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-51c837bd-aee6-4fb1-89ec-588e3f05be38 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1710 microversion: 2.1 time: 0.179176 Jul 29 14:40:32.022789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 291/585] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:31 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1710 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:32.300325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:32.305445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:32.310234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:32.310690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:32.311479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:32.311919 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:32.535294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:32.548598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9c557d40-c744-43e8-b319-813e54d3b6b4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.252697 Jul 29 14:40:32.550046 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 295/586] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:32 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:33.010908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:33.012922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:33.020519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.020959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.022056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.022640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.046392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:33.047896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:33.057253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.057994 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.059149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.059704 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.239179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:33.253463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:33.257209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:33.259030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c61202bb-cf4e-4844-a1b4-293f1db8ed09 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.252556 Jul 29 14:40:33.275849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 292/587] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:33 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:33.312766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:33.324700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4298cf4f-bf10-4e66-9b2d-4313fffa66ce tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1714 microversion: 2.1 time: 0.284301 Jul 29 14:40:33.326036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 296/588] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:33 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1714 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:33.570092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:33.573481 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:33.581196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.581928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.582890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:33.583486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:33.803628 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:33.813318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6cbe513d-fd9e-4a16-a2e0-bc68eb84b36e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.247060 Jul 29 14:40:33.829765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 293/589] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:33 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:34.287883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:34.288729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:34.294833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:34.296556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.297018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:34.297797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.298230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:34.455840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-186770334"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:34.456409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:34.467692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.468153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:34.468931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.473682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:34.542600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:34.552317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:34.554472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:34.556034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-18e90799-28c0-43cf-acab-05e9c7cda334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.272802 Jul 29 14:40:34.556705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 297/590] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:34 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:34.698130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.network.security_group_api [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Adding security group a777fe6a-cfb9-45a8-995a-2eec38da446b to port afab12c7-2e78-478f-a6fe-2683d302fb65 Jul 29 14:40:34.841188 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:34.841979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:34.849287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.850093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:34.851101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:34.851728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.026881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:35.036189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e45d4ce9-132a-4e1c-8df9-345e84574d0b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.199759 Jul 29 14:40:35.043565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 298/591] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:34 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:35.344592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a51c832b-2388-4a52-bf7d-93379f8fd4d0 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action" status: 202 len: 0 microversion: 2.1 time: 0.893515 Jul 29 14:40:35.345233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 294/592] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:40:34 2022] POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action => generated 0 bytes in 895 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:40:35.352807 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:35.353221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-1a3e927a-180e-4c46-bcc7-8314f1c85be6 req-c77595d5-7e24-486f-abd2-10d61294d4d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:35.353437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:35.364709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-1a3e927a-180e-4c46-bcc7-8314f1c85be6 req-c77595d5-7e24-486f-abd2-10d61294d4d6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:35.436327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-1a3e927a-180e-4c46-bcc7-8314f1c85be6 req-c77595d5-7e24-486f-abd2-10d61294d4d6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.436814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:35.436814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.436814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:35.436814 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.437156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-1a3e927a-180e-4c46-bcc7-8314f1c85be6 req-c77595d5-7e24-486f-abd2-10d61294d4d6 service nova] Creating event network-changed:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:40:35.437156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-1a3e927a-180e-4c46-bcc7-8314f1c85be6 req-c77595d5-7e24-486f-abd2-10d61294d4d6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Jul 29 14:40:35.437156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 299/593] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:40:35.580970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:35.581845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:35.588865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:35.590179 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.591247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:35.591770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:35.614766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:35.627628 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:35.642660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d20ecd46-e08a-4af9-a56b-bd48b8970ec3 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1759 microversion: 2.1 time: 0.293385 Jul 29 14:40:35.655916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 295/594] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:35 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1759 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:35.733242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:35.741705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:35.744921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:35.746768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ba3ecea2-f075-4e16-9164-1e8e013ac24f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.170293 Jul 29 14:40:35.747524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 300/595] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:35 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:36.061600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:36.064122 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:36.072507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:36.073335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:36.074888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:36.075723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:36.263766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:36.271615 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-61ba01ca-8ef7-4f17-94ff-651eabcff888 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.217432 Jul 29 14:40:36.285392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 296/596] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:36 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:36.770696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:36.771529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:36.779789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:36.780334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:36.781206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:36.781664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:36.931238 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:36.940370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:36.941902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:36.943264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d7b5dd67-ac74-4697-918b-7f6581b30044 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.176402 Jul 29 14:40:36.945676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 301/597] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:36 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:37.296506 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:37.297213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:37.299522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=96 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:37.305181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:37.305740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:37.306512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:37.306942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:37.451906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:37.466865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d24e53fe-8b6e-46ee-bada-60a63f92843b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.175678 Jul 29 14:40:37.467724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 297/598] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:37 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:37.973616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:37.975059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:37.986556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:37.987182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:37.988476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:37.989450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:38.152278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:38.161074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:38.164612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:38.166033 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9857f797-4b03-4739-a2d8-ccbf0308fdb7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.198503 Jul 29 14:40:38.167056 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 302/599] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:37 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:38.488100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:38.488673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:38.496207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:38.496658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:38.497504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:38.497953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:38.647676 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:38.655389 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2cd5ff06-9fad-4982-a3d8-4e52a14464df tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.171398 Jul 29 14:40:38.655956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 298/600] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:38 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:39.190198 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:39.190800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:39.197567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:39.198513 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:39.198833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:39.199399 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:39.348290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:39.357336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:39.358874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:39.360037 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-366d3144-3457-4748-be3f-d5b35733a7a8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.173815 Jul 29 14:40:39.360597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 303/601] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:39 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:39.675677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:39.676884 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:39.683710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:39.684251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:39.685153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:39.685590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:39.824618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:39.832586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-44d52002-9f9a-4e01-9e4f-aeefd1254889 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.160714 Jul 29 14:40:39.833399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 299/602] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:39 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:40.384755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:40.388090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:40.393261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:40.393604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:40.394381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:40.394814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:40.525215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:40.533970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:40.535493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:40.536645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d4dedd91-dbae-4bd0-b72f-fefaf9725e13 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1740 microversion: 2.20 time: 0.157194 Jul 29 14:40:40.537252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 304/603] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:40 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:40.853777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:40.854305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:40.861723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:40.862181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:40.862992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:40.863436 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:41.068834 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:41.076365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5d361c76-64c7-49ac-a7b7-374b7eb903e7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.226545 Jul 29 14:40:41.076931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 300/604] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:40 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:41.561325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:41.562206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:41.568606 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:41.569087 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:41.569851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:41.570288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:41.702870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:41.710796 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:41.712336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:41.713518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9ad039b8-4de0-425c-934d-803ce0e6d187 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1722 microversion: 2.20 time: 0.156205 Jul 29 14:40:41.714076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 305/605] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:41 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:42.096379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:42.097012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:42.104326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:42.104783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:42.106140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:42.106695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:42.280006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:42.287405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-df737be3-2911-4121-8894-7cc9e0a931e4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.194993 Jul 29 14:40:42.290618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 301/606] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:42 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:42.845004 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:42.846265 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:42.852261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:42.852977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:42.853852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:42.854437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:42.990175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:42.998889 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:43.000460 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:43.001650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5429ba4d-1849-4d77-9554-7647383546a6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1722 microversion: 2.20 time: 0.268073 Jul 29 14:40:43.002204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 306/607] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:42 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:43.309688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:43.310298 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:43.316899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:43.317378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:43.318164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:43.318584 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:43.445908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:43.453268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d8f7b893-f5ca-480f-ab45-0447a531e1ea tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.148175 Jul 29 14:40:43.453828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 302/608] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:43 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:44.024849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:44.025529 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:44.033141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:44.033590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:44.034354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:44.034790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:44.169349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:44.178632 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:44.180156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:44.181332 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5e9343b2-c8b1-4347-ac13-409a0f2a36ec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1722 microversion: 2.20 time: 0.160305 Jul 29 14:40:44.181894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 307/609] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:44 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:44.462230 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6b32ea44-8139-4b4f-9aa0-51198bc5aaaf req-776e87bd-b520-48bb-b4b0-e3ceb3903b2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275089c-3a8d-4785-9bea-bfa300e57580", "name": "network-vif-plugged", "status": "completed", "tag": "b09d2a6b-fd57-4a55-a66e-36abbc1e72c7"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:44.472697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6b32ea44-8139-4b4f-9aa0-51198bc5aaaf req-776e87bd-b520-48bb-b4b0-e3ceb3903b2f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:44.473187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6b32ea44-8139-4b4f-9aa0-51198bc5aaaf req-776e87bd-b520-48bb-b4b0-e3ceb3903b2f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:44.473450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:44.474071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:44.480044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:44.480499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:44.482041 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:44.484743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:44.495289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6b32ea44-8139-4b4f-9aa0-51198bc5aaaf req-776e87bd-b520-48bb-b4b0-e3ceb3903b2f service nova] Creating event network-vif-plugged:b09d2a6b-fd57-4a55-a66e-36abbc1e72c7 for instance 6275089c-3a8d-4785-9bea-bfa300e57580 on hv-cinder-79987 Jul 29 14:40:44.500964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6b32ea44-8139-4b4f-9aa0-51198bc5aaaf req-776e87bd-b520-48bb-b4b0-e3ceb3903b2f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042521 Jul 29 14:40:44.501578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 303/610] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:44.622036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:44.629971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a83e12e9-c29f-4b33-909f-e5a3e9c2d021 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.160275 Jul 29 14:40:44.630534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 308/611] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:44 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:45.205464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:45.206187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:45.212299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.212751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.213538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.213973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.343484 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:45.351406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:45.352916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:45.354093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-baf4a59f-1565-42e3-9dd2-13bef67f2170 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1725 microversion: 2.20 time: 0.152931 Jul 29 14:40:45.354652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 304/612] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:45 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:45.376866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d9c7e2a-d108-4aa2-ae73-1a73e1422433"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:45.379363 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:45.385918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.386366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.387207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.387616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.650302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:45.650916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:45.658544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.659003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.659832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:45.660274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:45.796187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:45.804036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8111ed6e-7aa2-45e4-9cf3-504973142ba4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.157650 Jul 29 14:40:45.804605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 305/613] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:45 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:46.365859 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bbe8640a-5a29-4934-955c-063d83a4e356 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.992904 Jul 29 14:40:46.366694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 309/614] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Jul 29 14:40:45 2022] POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments => generated 188 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:40:46.489893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:46.490585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:46.497164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.497630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.498464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.498964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.517801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-07f88165-584c-489b-85c7-209b442c0287 req-6bce2e51-fdb3-498b-af92-d0396f34b8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "name": "network-vif-unplugged", "status": "completed", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:46.530024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-07f88165-584c-489b-85c7-209b442c0287 req-6bce2e51-fdb3-498b-af92-d0396f34b8a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.530479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-07f88165-584c-489b-85c7-209b442c0287 req-6bce2e51-fdb3-498b-af92-d0396f34b8a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.541101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-07f88165-584c-489b-85c7-209b442c0287 req-6bce2e51-fdb3-498b-af92-d0396f34b8a1 service nova] Creating event network-vif-unplugged:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:40:46.542953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124771) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 14:40:46.547166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-07f88165-584c-489b-85c7-209b442c0287 req-6bce2e51-fdb3-498b-af92-d0396f34b8a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033200 Jul 29 14:40:46.547759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 310/615] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:46.824148 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:46.824764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:46.831026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.832096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.832269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.832723 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.836430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-12fa1695-4036-4bc5-b670-121fd334a0a7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/action" status: 202 len: 0 microversion: 2.20 time: 0.350467 Jul 29 14:40:46.837043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 306/616] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 14:40:46 2022] POST /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/action => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:40:46.845801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:46.846416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:46.852658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.853229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.853980 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:46.854429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:46.993877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:47.002287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d393a876-9f01-4505-b42b-cc29d0974ec7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1265 microversion: 2.1 time: 0.182272 Jul 29 14:40:47.005146 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 311/617] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:46 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:47.006501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:47.015730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:47.018738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:47.019942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e78d5646-a6de-4790-95cd-767d4718bd41 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1811 microversion: 2.20 time: 0.178817 Jul 29 14:40:47.020485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 307/618] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:46 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1811 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:48.023766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:48.024243 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:48.035345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.035345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.035345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.035345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.043483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:48.044083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:48.051153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.051591 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.052793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.053423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.057953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:48.180769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:48.194869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-198a6610-5768-48dc-94b7-ed19c790e433 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1452 microversion: 2.1 time: 0.171106 Jul 29 14:40:48.194869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 312/619] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:48 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1452 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:40:48.196969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:48.206881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:48.208607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:48.209879 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d5dde0a9-64dd-4007-923a-9e5d7f138eca tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1751 microversion: 2.20 time: 0.170393 Jul 29 14:40:48.210423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 308/620] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:48 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:40:48.212139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:48.212750 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:48.218769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.219208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.219986 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:48.220416 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:48.354839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:48.362608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e60b604a-1399-40f7-996a-d9afffde03f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1452 microversion: 2.1 time: 0.154514 Jul 29 14:40:48.363170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 313/621] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:40:48 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:40:49.233241 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:49.233897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:49.240896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:49.241378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:49.242189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:49.242629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:49.372062 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:49.380633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:49.382216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:49.383436 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9b5d7d7c-644d-4758-a848-52cf740e1fa7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1753 microversion: 2.20 time: 0.154949 Jul 29 14:40:49.383992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 309/622] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:49 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:50.374954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-3b971f0c-200c-4e95-8efd-008fcd9dc764 req-c632b47a-2d8a-4bf3-a956-3bae8ebe46bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6275089c-3a8d-4785-9bea-bfa300e57580", "tag": "b09d2a6b-fd57-4a55-a66e-36abbc1e72c7"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:50.386121 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3b971f0c-200c-4e95-8efd-008fcd9dc764 req-c632b47a-2d8a-4bf3-a956-3bae8ebe46bd service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:50.386565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3b971f0c-200c-4e95-8efd-008fcd9dc764 req-c632b47a-2d8a-4bf3-a956-3bae8ebe46bd service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:50.397428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-3b971f0c-200c-4e95-8efd-008fcd9dc764 req-c632b47a-2d8a-4bf3-a956-3bae8ebe46bd service nova] Creating event network-changed:b09d2a6b-fd57-4a55-a66e-36abbc1e72c7 for instance 6275089c-3a8d-4785-9bea-bfa300e57580 on hv-cinder-79987 Jul 29 14:40:50.404669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-3b971f0c-200c-4e95-8efd-008fcd9dc764 req-c632b47a-2d8a-4bf3-a956-3bae8ebe46bd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034410 Jul 29 14:40:50.405456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 314/623] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:40:50.409271 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:50.409916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:50.416834 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:50.417336 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:50.418107 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:50.418535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:50.557061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:50.566774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:50.568630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:50.569908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5f64cbc6-d417-481d-be2b-3a2482c3448a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.166114 Jul 29 14:40:50.570469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 310/624] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:50 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:51.594437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:51.595713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:51.602853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:51.603623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:51.604673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:51.605380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:51.744566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:51.748898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:40:51.754162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:51.759654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:51.759654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-14a99e42-2fab-48d6-8de2-d8300507bb11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.167148 Jul 29 14:40:51.759654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 315/625] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:51 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:52.782405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:52.783732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:52.793580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:52.794710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:52.796066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:52.796719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:52.941657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:52.950110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:52.952495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:52.953935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4d9414ba-89dc-4e06-8d3d-35c8962c7b61 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.177482 Jul 29 14:40:52.954500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 311/626] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:52 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:53.979117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:53.980615 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:53.989832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:53.990412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:53.991278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:53.991776 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:54.125207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:54.133903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:54.136714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:54.137955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-259ba310-01a5-4cc2-86a9-4cd7b37c56c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.164470 Jul 29 14:40:54.139116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 316/627] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:53 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:55.164593 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:55.165524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:55.173864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:55.174586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:55.175233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:55.175842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:55.338297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:55.349217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:55.363290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:55.363290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-89a9a361-a9bb-4cb8-b9b8-38eaf8fcbdad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.192263 Jul 29 14:40:55.363290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 312/628] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:55 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:56.385046 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:56.385867 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:56.393853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:56.394381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:56.395277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:56.395829 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:56.751692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:56.757556 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:56.759434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:56.760911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e2ef0e33-693f-4218-b66c-93081e363f11 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.380493 Jul 29 14:40:56.764211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 317/629] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:56 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:57.787453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:57.788121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:57.797160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:57.797622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:57.798831 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:57.799280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:57.937443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:57.945822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:57.947320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:57.948469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8f73498a-7a02-489c-b2bf-9ebbc33c6f3b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.165904 Jul 29 14:40:57.949059 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 313/630] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:57 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:40:58.935435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:40:58.938656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:58.945318 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:58.945766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:58.946706 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:58.947177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:58.971823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:40:58.973147 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:40:58.979802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:58.980338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:58.984188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:40:58.984646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:40:59.127513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:59.136396 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:59.137966 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:40:59.139103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e6380ce-e922-435c-b4bb-59b99afa5702 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.171445 Jul 29 14:40:59.140413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 314/631] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:40:58 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:00.166576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:00.167224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:00.174186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:00.174637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:00.175411 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:00.175847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:00.317863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:00.335133 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:00.336649 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:00.338019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8891954d-a3c5-4dc0-a9d1-bdf777b91324 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.175663 Jul 29 14:41:00.339176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 315/632] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:00 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:01.362781 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:01.363469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:01.369800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:01.370251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:01.371015 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:01.371446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:01.507501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:01.515989 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:01.517518 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:01.518671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b5adb3fd-3109-4e25-9479-359f8187c02f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.159774 Jul 29 14:41:01.519234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 316/633] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:01 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:02.544930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:02.547395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:02.554525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:02.557573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:02.557573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:02.557573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:02.694560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:02.706572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:02.709077 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:02.710438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-384edba3-28fa-4b77-a980-19464a2a296d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.170985 Jul 29 14:41:02.711188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 317/634] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:02 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:03.738254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:03.739276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:03.770234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:03.770671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:03.771476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:03.771908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:03.909767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:03.918385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:03.919984 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:03.921947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-677a1de4-2d78-45e7-bf5f-8b9b80754185 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.189321 Jul 29 14:41:03.922598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 318/635] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:03 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:04.948630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:04.949356 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:04.956384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:04.956860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:04.957666 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:04.962335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:05.104055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:05.114082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:05.115606 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:05.116778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-49f89d6d-98b6-4b06-b41c-c16c1691edad tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.172977 Jul 29 14:41:05.117366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 319/636] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:04 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:06.144041 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:06.144800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:06.152168 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:06.153100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:06.153473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:06.153914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:06.287118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:06.295662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:06.297804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:06.298953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0071f6a3-349e-4c8a-a626-64ac3ac9340f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.159060 Jul 29 14:41:06.299517 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 320/637] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:06 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:07.322308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:07.322981 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:07.329563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:07.330008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:07.330771 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:07.331213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:07.461427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:07.470303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:07.471821 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:07.472961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-90df876d-a5c5-4329-a4c8-c3281a6c8a8e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.154590 Jul 29 14:41:07.473541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 321/638] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:07 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:08.495699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:08.496327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:08.498581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:08.503884 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:08.504333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:08.505131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:08.505567 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:08.638255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:08.646786 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:08.648280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:08.649459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8fce3360-87d9-45ba-9940-f1746410bff8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.157749 Jul 29 14:41:08.650015 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 322/639] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:08 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:08.942380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=43 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:09.039903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=18 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:09.672742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:09.673379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:09.680048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:09.680500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:09.681300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:09.681739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:09.809913 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:09.818364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:09.819860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:09.821019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5d879bb9-2ce8-41e9-9595-3287187fc844 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.152275 Jul 29 14:41:09.821585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 323/640] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:09 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:10.844423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:10.845146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:10.851541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:10.851989 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:10.852751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:10.853222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:10.979872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:10.983250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:10.989088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:10.990592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:10.991801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1609d6f3-9f1a-4307-88aa-30f4c661b0b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.151745 Jul 29 14:41:10.992358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 324/641] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:10 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:12.014997 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:12.016287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:12.023509 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:12.023967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:12.024742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:12.025213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:12.162060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:12.170416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:12.172058 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:12.173229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-da2298d7-1e91-415b-9541-440fd5b43ac8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.162011 Jul 29 14:41:12.173782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 325/642] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:12 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:12.478020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-14c906dd-0fa2-4c44-b124-92e2404b2f07 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 13.671323 Jul 29 14:41:12.478921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 318/643] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:40:58 2022] POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments => generated 194 bytes in 13673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:41:13.197312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:13.197923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:13.205067 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:13.205522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:13.206294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:13.206733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:13.334779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:13.343072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:13.344586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:13.345793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3f252ab0-b342-473f-a522-05878d6d2f77 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.152435 Jul 29 14:41:13.346354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 326/644] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:13 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:14.370565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:14.371180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:14.378055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:14.378499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:14.379257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:14.379688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:14.509816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:14.518820 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:14.520315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:14.521523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2646c0e5-82d4-4f20-bac0-d2f36b02343f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.155874 Jul 29 14:41:14.522275 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 319/645] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:14 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:15.544296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:15.544907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:15.551474 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:15.552190 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:15.552961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:15.553427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:15.684569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:15.693644 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:15.695149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:15.696294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e1dd39f2-166a-4bf0-97e9-b74c10eef1f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.155873 Jul 29 14:41:15.696852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 327/646] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:15 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:16.720146 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:16.720758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:16.727287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:16.727742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:16.728506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:16.728945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:16.860577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:16.868777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:16.870300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:16.871445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-fc094933-0203-45b2-9d14-d99df4b324da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.155809 Jul 29 14:41:16.871995 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 320/647] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:16 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:17.894727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:17.895357 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:17.901982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:17.902420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:17.903174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:17.903607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:18.039172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:18.049650 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:18.051348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:18.052920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-35a246f5-6d26-439d-a271-c4fc013b2abc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.163139 Jul 29 14:41:18.053979 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 328/648] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:17 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:19.076849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:19.077494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:19.084215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:19.084660 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:19.085449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:19.085881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:19.214498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:19.223688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:19.225274 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:19.226550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ab00b3db-3475-4882-8a9b-82b823331f82 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.153560 Jul 29 14:41:19.227118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 321/649] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:19 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:20.249706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:20.250350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:20.256889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:20.257375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:20.258146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:20.258584 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:20.387601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:20.396768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:20.398306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:20.399490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-915be452-188e-446f-b5a1-3a6e8ce382fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.153731 Jul 29 14:41:20.400055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 329/650] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:20 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:41:21.059863 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:21.062783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:21.069252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.069705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.070472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.070911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.094191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'flavor' on Instance uuid d9feeb90-af89-4905-8830-d88a13334f0a {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:41:21.354460 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6144616e-9917-411c-a69e-86376c933b7d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/action" status: 200 len: 32 microversion: 2.1 time: 0.298482 Jul 29 14:41:21.355069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 322/651] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:41:21 2022] POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/action => generated 32 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:41:21.365181 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:21.365911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:21.372231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.372872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.373475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.373916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.423455 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:21.424183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:21.430948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.431411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.432803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:21.433276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:21.523399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:21.532098 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-54ee08b6-df95-4ef8-bca3-2f2e41cf85aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.170373 Jul 29 14:41:21.532602 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 330/652] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:21 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:21.589744 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:21.598733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:21.600267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:21.601453 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-90ed4317-376e-40c1-b3ab-f741a6fdb15d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.182638 Jul 29 14:41:21.602067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 323/653] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:21 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:22.553306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:22.553928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:22.560308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:22.560764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:22.561570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:22.562769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:22.626145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:22.626778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:22.633481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:22.633925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:22.634699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:22.635127 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:22.692808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:22.700667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c78639d8-4ac6-4c5a-9730-37e309afdc5c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.151454 Jul 29 14:41:22.701252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 331/654] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:22 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:22.764339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:22.772872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:22.774382 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:22.775527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-30278079-0053-444c-a23b-eb97bf96d9b1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.154325 Jul 29 14:41:22.776083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 324/655] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:22 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:22.971532 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-cefb2dbc-1a0b-474f-adbc-c6012d871d41 req-a03228e7-623c-44ba-8e43-0c9a09c594b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "name": "network-vif-plugged", "status": "completed", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:22.981300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-cefb2dbc-1a0b-474f-adbc-c6012d871d41 req-a03228e7-623c-44ba-8e43-0c9a09c594b0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:22.981753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-cefb2dbc-1a0b-474f-adbc-c6012d871d41 req-a03228e7-623c-44ba-8e43-0c9a09c594b0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:22.992904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-cefb2dbc-1a0b-474f-adbc-c6012d871d41 req-a03228e7-623c-44ba-8e43-0c9a09c594b0 service nova] Creating event network-vif-plugged:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:41:22.997833 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-cefb2dbc-1a0b-474f-adbc-c6012d871d41 req-a03228e7-623c-44ba-8e43-0c9a09c594b0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030573 Jul 29 14:41:22.998428 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 332/656] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:41:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:41:23.722216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:23.722825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:23.732104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:23.732910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:23.734308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:23.735096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:23.800474 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:23.801228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:23.807878 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:23.808330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:23.809140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:23.809584 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:23.872059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:23.880436 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7af109ce-fea6-4669-a325-644267e9ec35 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.162656 Jul 29 14:41:23.881027 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 325/657] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:23 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:41:23.994888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:24.003595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:24.005119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:24.006266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd34b338-51c6-4cdb-87e1-73be2ed5df49 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.211147 Jul 29 14:41:24.006858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 333/658] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:23 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:24.902342 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:24.902945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:24.909715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:24.910160 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:24.910915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:24.911339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:25.041772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:25.042503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:25.043113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:25.049743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:25.050117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0a55ebdf-03a1-413f-a5e5-a1383db733d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.151560 Jul 29 14:41:25.050238 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:25.050888 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 326/659] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:24 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:41:25.051021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:25.051377 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:25.183403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:25.191667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:25.193321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:25.194471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ae6dbff-5c68-4d6c-8c2e-d0092f8261d0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.156110 Jul 29 14:41:25.195026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 334/660] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:25 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:26.072142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:26.072754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:26.079775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:26.080224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:26.081006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:26.081458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:26.208635 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:26.216711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3d5902d7-c72c-459e-ad27-488a7d6d901c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.148390 Jul 29 14:41:26.217300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 327/661] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:26 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:26.217887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:26.218575 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:26.225587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:26.226026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:26.226791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:26.227219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:26.353592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:26.362082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:26.363590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:26.364720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2ed4b4d6-505a-4dc1-b334-917b7f05b598 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.150690 Jul 29 14:41:26.365304 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 335/662] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:26 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:27.239285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:27.240048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:27.246345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:27.246797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:27.247565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:27.248002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:27.382304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:27.388421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:27.389095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:27.390380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-994ac50e-3170-447f-bc48-bd7ba4801e16 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.155866 Jul 29 14:41:27.391447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 328/663] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:27 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:27.395968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:27.396424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:27.397237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:27.397683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:27.527558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:27.536291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:27.537829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:27.538990 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-879ba5a1-1834-4867-ac23-e15a8fa38bec tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1809 microversion: 2.20 time: 0.154396 Jul 29 14:41:27.539553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 336/664] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:27 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:28.413812 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:28.414354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:28.420818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:28.421299 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:28.422069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:28.422514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:28.549321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:28.557614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d1808d0c-a9ac-44d8-ab14-8e3c3525ac9a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.147613 Jul 29 14:41:28.558493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 329/665] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:28 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:28.563424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:28.564131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:28.570501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:28.570949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:28.571715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:28.572149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:28.706711 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:28.715110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:28.716603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:28.717777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7568e12a-a6dc-44ae-9fb7-851f8c2c443c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1796 microversion: 2.20 time: 0.158798 Jul 29 14:41:28.718328 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 337/666] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:41:28 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1796 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:41:29.579261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:29.579972 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:29.586425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:29.586867 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:29.587625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:29.588055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:29.716516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:29.724462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c24d7970-45d9-4362-8f03-98db6261fd39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.149660 Jul 29 14:41:29.725077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 330/667] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:29 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:30.745430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:30.746064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:30.753118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:30.753567 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:30.754329 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:30.754764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:30.882344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:30.890119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fe359695-2379-437f-b811-14bad8c59293 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.148508 Jul 29 14:41:30.890680 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 338/668] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:30 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:31.912101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:31.912640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:31.918644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:31.919090 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:31.919847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:31.920277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:32.054664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:32.062755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a6bef2a6-b57c-443c-97f2-90047a1370d6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.155341 Jul 29 14:41:32.063333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 331/669] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:31 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:33.085378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:33.085984 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:33.092575 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:33.093070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:33.093823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:33.094260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:33.224747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:33.232568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-25f2fc70-a3e0-4392-b4ed-7dd6797d595f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.151084 Jul 29 14:41:33.233146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 339/670] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:33 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:34.254044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:34.254650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:34.261128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:34.261596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:34.262345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:34.262781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:34.267317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:34.391417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:34.399778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-35a1fad0-d211-4f29-b7c5-c39378b91c20 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.149585 Jul 29 14:41:34.400340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 332/671] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:34 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:35.421703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:35.422261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:35.430438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:35.430888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:35.431660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:35.432095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:35.557056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:35.565490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-79e94d84-9938-45fe-a9b3-bdf17fbbff39 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.147791 Jul 29 14:41:35.566054 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 340/672] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:35 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:36.586810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:36.599881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:36.599881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:36.599881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:36.599881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:36.600298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:36.727300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:36.735099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d34a87c7-37d6-470f-8e6a-d45444750b0b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.152118 Jul 29 14:41:36.735715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 333/673] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:36 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:37.756295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:37.756826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:37.763277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:37.763724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:37.764487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:37.764924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:37.895849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:37.903791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1a61fb5d-f594-4fac-a340-4c3b6341f34e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.151359 Jul 29 14:41:37.904347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 341/674] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:37 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:38.924581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:38.925231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:38.931957 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:38.932408 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:38.933201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:38.933640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:39.061369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:39.070031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-34eea074-1ea4-4fdc-9b07-b98569d80490 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.149481 Jul 29 14:41:39.070834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 334/675] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:38 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:40.092322 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:40.092934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:40.095159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=40 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:40.100722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:40.101211 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:40.102108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:40.102545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:40.106414 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:40.231308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:40.239467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b059d18c-2c3b-432d-b3ee-f53a3ba482e6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.150983 Jul 29 14:41:40.240038 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 342/676] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:40 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:41.260705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:41.261346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:41.263684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=33 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:41:41.269224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:41.269617 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:41.270417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:41.270856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:41.399405 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:41.407258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4d1ac1e2-dd02-4bf5-944d-9651ebd2ca9d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.150362 Jul 29 14:41:41.407817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 335/677] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:41 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:42.429637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:42.430246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:42.436619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:42.437096 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:42.437858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:42.438290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:42.634021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:42.643549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-009af728-9b9b-4f30-9624-c2b625075528 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.217269 Jul 29 14:41:42.644326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 343/678] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:42 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:43.663879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:43.664493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:43.671038 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:43.671494 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:43.672259 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:43.672696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:43.799814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:43.808002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1d3172cd-a92f-47f8-ba61-57d666fbbdff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.147957 Jul 29 14:41:43.808565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 336/679] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:43 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:44.829060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:44.829695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:44.836189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:44.836642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:44.837447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:44.837891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:44.970059 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:44.979159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7e7ae1fc-56c2-40b2-8bb7-18f02f6aad6b tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.153996 Jul 29 14:41:44.979730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 344/680] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:44 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:46.000799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:46.001449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:46.007637 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:46.011074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:46.011074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:46.011074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:46.136831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:46.145717 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e73a970b-6a6f-4980-8521-0605661d53b7 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.148704 Jul 29 14:41:46.146215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 337/681] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:45 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:47.166443 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:47.167046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:47.173527 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:47.174464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:47.175228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:47.175664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:47.300505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:47.308536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5c47269b-1d26-41d9-9e6d-4c3a545d7879 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1735 microversion: 2.1 time: 0.146049 Jul 29 14:41:47.309121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 345/682] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:47 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:48.330657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:48.331301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:48.337782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.338224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.338975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.339412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.469587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:48.478115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f2cd8213-e7b1-4e5e-b50b-82508a0827df tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1715 microversion: 2.1 time: 0.151892 Jul 29 14:41:48.478675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 338/683] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:48 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1715 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:48.537926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:48.538409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:48.544809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.545302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.546068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.546510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.667742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] HTTP exception thrown: Cannot 'detach_volume' instance d9feeb90-af89-4905-8830-d88a13334f0a while it is in vm_state rescued Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Request method failure captured: Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments/d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3 HTTP/1.1 Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BE_a6vp_K8n1-US6WzucaZhFMyenbjTPUTnVeyOSxu0FM6xOYjY0UB936Vly2_5OLEouw-KH2CvHYYf4xrIhLlbVPEdTXfzXd9jGJ3V5sZ3BgahC6p8sX-WkwP_t4v9-Z2eD71KczBhgeGnaDpRwCFHhdvZZm0DSsNYnPYVSixxps Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:41:48.669368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82cd919860e249acb9dea7620506725b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82cd919860e249acb9dea7620506725b"}]}] Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f4ae3fb6a7954a24b88df4f35f55020c Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:41:48.670956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Cannot 'detach_volume' instance d9feeb90-af89-4905-8830-d88a13334f0a while it is in vm_state rescued Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'server_id': 'd9feeb90-af89-4905-8830-d88a13334f0a', 'id': 'd2a3a7c2-e925-4f05-bc4c-f4651b31a1f3'} Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d9feeb90-af89-4905-8830-d88a13334f0a in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:41:48.671783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d9feeb90-af89-4905-8830-d88a13334f0a while it is in vm_state rescued Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d9feeb90-af89-4905-8830-d88a13334f0a while it is in vm_state rescued Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:41:48.673297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Returning 409 to user: Cannot 'detach_volume' instance d9feeb90-af89-4905-8830-d88a13334f0a while it is in vm_state rescued {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:41:48.674493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d695d1ae-d391-4297-a19a-aaafe762c204 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments/d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3" status: 409 len: 152 microversion: 2.1 time: 0.137527 Jul 29 14:41:48.674493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 346/684] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:41:48 2022] DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments/d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3 => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 29 14:41:48.680036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:48.680576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:48.687531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.687980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.688748 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.689215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.968131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e5fe71e0-3585-4af4-826b-80c55392d509 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/action" status: 202 len: 0 microversion: 2.1 time: 0.268709 Jul 29 14:41:48.968131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 339/685] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:41:48 2022] POST /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:41:48.978535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:48.980228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:48.993210 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.994037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:48.994934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:48.995744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:49.135662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:49.143738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9711bf0b-8ee4-4d53-86c2-ce5dde7de86d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1723 microversion: 2.1 time: 0.171607 Jul 29 14:41:49.144299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 347/686] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:48 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:41:50.166770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:50.167469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:50.173628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:50.174609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:50.175369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:50.175803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:50.304104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:50.312003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bf19b86b-e6e4-463e-82bb-26db752f6d25 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1723 microversion: 2.1 time: 0.149930 Jul 29 14:41:50.312567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 340/687] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:50 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:51.333511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:51.334132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:51.340617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:51.341105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:51.342052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:51.342500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:51.471435 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:51.479368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ae62c2cc-d622-404d-9040-f5ee59ae6764 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1723 microversion: 2.1 time: 0.150237 Jul 29 14:41:51.479930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 348/688] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:51 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:52.502452 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:52.503069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:52.509638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:52.510094 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:52.510868 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:52.511310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:52.640629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:52.649568 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ab943571-2093-43a0-a207-32a9c3c1e3ff tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1723 microversion: 2.1 time: 0.151567 Jul 29 14:41:52.650128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 341/689] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:52 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:53.670447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:53.671061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:53.678321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:53.678770 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:53.679568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:53.680008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:53.807426 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:53.816037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b995c2d6-4fc4-4c82-b945-35b9f13b2add tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1723 microversion: 2.1 time: 0.149407 Jul 29 14:41:53.816609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 349/690] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:53 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:54.837419 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:54.838055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:54.845016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:54.846191 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:54.847333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:54.847768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:54.979077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:54.987801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9d84ee78-48ac-427d-bb68-0edf71ae34b0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1729 microversion: 2.1 time: 0.154415 Jul 29 14:41:54.989101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 342/691] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:54 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:55.008374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:55.008900 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:55.015276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:55.015732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:55.016504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:55.017087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:55.100105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2bb40c9a-36f9-4509-80ac-09ff4b8f03de tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095561 Jul 29 14:41:55.100698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 350/692] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:41:55 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:41:56.076151 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-f20e1ec8-698a-4c85-96ab-07db52015005 req-f6655445-fca4-418d-a44f-9daae5a8a0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:56.086179 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f20e1ec8-698a-4c85-96ab-07db52015005 req-f6655445-fca4-418d-a44f-9daae5a8a0a5 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:56.086629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f20e1ec8-698a-4c85-96ab-07db52015005 req-f6655445-fca4-418d-a44f-9daae5a8a0a5 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:56.098397 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-f20e1ec8-698a-4c85-96ab-07db52015005 req-f6655445-fca4-418d-a44f-9daae5a8a0a5 service nova] Creating event network-changed:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:41:56.103592 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-f20e1ec8-698a-4c85-96ab-07db52015005 req-f6655445-fca4-418d-a44f-9daae5a8a0a5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091002 Jul 29 14:41:56.104209 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 343/693] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:41:58.118524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-f8d04a4b-774b-4301-ac94-2fff76bcec45 req-2ff39996-a1ec-4453-a73d-c1c34c5ef8b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:58.128653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f8d04a4b-774b-4301-ac94-2fff76bcec45 req-2ff39996-a1ec-4453-a73d-c1c34c5ef8b9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:58.133064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f8d04a4b-774b-4301-ac94-2fff76bcec45 req-2ff39996-a1ec-4453-a73d-c1c34c5ef8b9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:58.140707 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-f8d04a4b-774b-4301-ac94-2fff76bcec45 req-2ff39996-a1ec-4453-a73d-c1c34c5ef8b9 service nova] Creating event network-changed:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:41:58.146092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-f8d04a4b-774b-4301-ac94-2fff76bcec45 req-2ff39996-a1ec-4453-a73d-c1c34c5ef8b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Jul 29 14:41:58.146707 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 351/694] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:41:58.563134 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:41:58.565694 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:58.572036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:58.572493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:58.573302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:58.573746 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:58.776005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-669824fc-280e-406e-996a-a2142358c357 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action" status: 202 len: 0 microversion: 2.1 time: 0.217533 Jul 29 14:41:58.776667 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 344/695] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:41:58 2022] POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 14:41:58.785858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:58.786841 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:58.792661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:58.793302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:58.794087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:58.794526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:58.939951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:41:58.947868 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c805e3bf-0806-4184-850d-e7973c992b1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1751 microversion: 2.1 time: 0.166902 Jul 29 14:41:58.948433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 352/696] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:58 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:41:59.969759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:41:59.970979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:41:59.977252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:59.977707 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:41:59.978481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:41:59.978928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:00.125741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:00.134663 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f9e490ac-af67-45a6-9222-06dc778a4f69 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.169605 Jul 29 14:42:00.135441 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 345/697] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:41:59 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:01.156630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:01.157269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:01.163871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:01.164347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:01.165143 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:01.165582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:01.308346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:01.316940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f987d366-7d9e-4cd2-bc29-4c35e2bb76bb tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.164227 Jul 29 14:42:01.317522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 353/698] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:01 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:02.337964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:02.339056 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:02.345109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:02.345573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:02.346336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:02.346774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:02.488584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:02.496698 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-dca259fb-ae4b-4ab0-b201-34260126643e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.162592 Jul 29 14:42:02.497292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 346/699] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:02 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:03.518474 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:03.519079 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:03.525785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:03.526231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:03.526988 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:03.527418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:03.667312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:03.675998 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-792e9813-a1ba-4ccb-bc17-1a38486cb8e5 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.161988 Jul 29 14:42:03.676561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 354/700] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:03 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:04.041289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:04.041798 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:04.047819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:04.048766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:04.049659 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:04.050130 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:04.107335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:04.172966 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lazy-loading 'services' on Instance uuid 3bd0a632-5ab1-4f92-8793-e25143d73dac {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:04.450955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c82df305-891a-480d-81eb-cb49433ed1f3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments/5b66232b-3532-4449-b317-01c3c7061a7c" status: 202 len: 0 microversion: 2.1 time: 0.512601 Jul 29 14:42:04.451545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 347/701] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:42:03 2022] DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments/5b66232b-3532-4449-b317-01c3c7061a7c => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:04.697195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:04.697811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:04.704183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:04.704737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:04.705651 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:04.706093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:04.846475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:04.854347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dfcb5b3d-fad2-4ffb-8adb-7176634f20a2 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.160971 Jul 29 14:42:04.854924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 355/702] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:04 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:05.876282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:05.877035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:05.883486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:05.883933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:05.884695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:05.885160 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:06.030728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:06.039295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-72fe0548-5086-4854-bcb4-f4695e270fc7 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.167769 Jul 29 14:42:06.039856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 348/703] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:05 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:06.629534 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-30dbe35f-07db-4983-a52a-b21815ea669d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:06.636059 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30dbe35f-07db-4983-a52a-b21815ea669d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:06.636598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30dbe35f-07db-4983-a52a-b21815ea669d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:06.698261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-30dbe35f-07db-4983-a52a-b21815ea669d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Going to try to stop instance {{(pid=124771) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Jul 29 14:42:06.877794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-30dbe35f-07db-4983-a52a-b21815ea669d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action" status: 202 len: 0 microversion: 2.1 time: 0.251822 Jul 29 14:42:06.878305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 356/704] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:42:06 2022] POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:06.890719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:06.891329 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:06.898337 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:06.898784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:06.899545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:06.899977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:07.036630 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:07.044290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a602ce76-7066-497c-9f7c-8cc47ae9b184 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.157567 Jul 29 14:42:07.047828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 349/705] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:06 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:07.060827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:07.061577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:07.068400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:07.068854 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:07.069663 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:07.070101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:07.216290 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:07.224350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c1957847-ed68-4db7-8edb-1449f11006c8 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.167645 Jul 29 14:42:07.224911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 357/706] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:07 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:08.067131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:08.067739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:08.074256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:08.074708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:08.075473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:08.075909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:08.204218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:08.211741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f120e677-cf03-4d2a-9d49-1cfa26f536ea tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.149103 Jul 29 14:42:08.212303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 350/707] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:08 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:08.245920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:08.246533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:08.252919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:08.253401 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:08.254165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:08.254600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:08.395849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:08.399343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:08.404113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8af9a77c-9ddc-4bed-ba07-df55bb88ebed tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.161946 Jul 29 14:42:08.404680 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 358/708] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:08 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:09.233199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:09.233836 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:09.240635 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:09.241115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:09.241954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:09.242397 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:09.371601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:09.379681 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-44f9ebee-3f58-4c80-b23d-d014803b60d7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.150394 Jul 29 14:42:09.380243 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 351/709] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:09 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:09.426885 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:09.427429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:09.433743 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:09.434195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:09.434961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:09.435396 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:09.579705 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:09.587740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-934a4d30-968f-4e17-a151-15cff95d1d2d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.166049 Jul 29 14:42:09.588307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 359/710] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:09 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:10.400491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:10.401206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:10.407636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.408088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.408853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.409971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.536131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:10.543464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-96275584-416c-42a6-9a08-ff6599c64ffd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.146855 Jul 29 14:42:10.544031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 352/711] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:10 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:10.608773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:10.609420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:10.611683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=36 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:10.616401 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.616851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.617646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.618087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.759547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:10.767387 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1464adeb-5dda-4340-9997-947babb38afc tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.162469 Jul 29 14:42:10.767947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 360/712] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:10 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:10.897392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:10.897896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:10.903845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.904301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.905111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.905555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.928331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e8009613-2f05-48a4-aea2-a693e0f80a9c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/ips" status: 200 len: 149 microversion: 2.1 time: 0.083430 Jul 29 14:42:10.928879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 353/713] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:42:10 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/ips => generated 149 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:10.940768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fcefe0a0-b458-45d1-9f8d-07f79e398b82"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:10.943218 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:10.949242 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.949639 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:10.950406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:10.950844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.031803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: POST /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/os-volume_attachments HTTP/1.1 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 74 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:42:11.033537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {"volumeAttachment": {"volumeId": "fcefe0a0-b458-45d1-9f8d-07f79e398b82"}} Jul 29 14:42:11.035405 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'server_id': 'e1b03f71-e979-45c1-a50f-40bbb4ef2bad', 'body': {'volumeAttachment': {'volumeId': 'fcefe0a0-b458-45d1-9f8d-07f79e398b82'}}} Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:11.036206 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:11.037423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 400 to user: Invalid volume: volume fcefe0a0-b458-45d1-9f8d-07f79e398b82 is already attached to instances: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c4a5c795-0386-4c6f-b357-99630445d600 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098793 Jul 29 14:42:11.038657 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 361/714] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:42:10 2022] POST /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:42:11.043994 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:11.044496 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:11.051600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.052108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.054150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.054150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.078198 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:42:11.365928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0360e14f-8b33-45c2-9ea0-679c7a72ad8d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 204 len: 0 microversion: 2.1 time: 0.325466 Jul 29 14:42:11.366517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 354/715] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:42:11 2022] DELETE /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:42:11.374686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:11.375343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:11.381505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.381953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.382716 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.383154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.515212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:11.523012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5dfd249b-fac9-4769-aaf4-c7a39d8b354a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1681 microversion: 2.1 time: 0.152130 Jul 29 14:42:11.523578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 362/716] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:11 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:11.565431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:11.566179 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:11.568612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:11.573395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.573842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.574629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.575060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.705559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:11.712985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-610c10a2-e8ad-468b-bb27-085741295fbb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.151920 Jul 29 14:42:11.713566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 355/717] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:11 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:11.789126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:11.789749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:11.796200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.796681 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.797476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:11.797914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:11.938504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:11.946539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4d474747-54ee-4fb8-914e-53d1b05c4f7a tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.161392 Jul 29 14:42:11.947104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 363/718] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:11 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:12.544658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:12.545325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:12.551730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.552174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:12.552935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.553396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:12.681753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:12.689005 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-fb4205df-9670-4b35-9802-f1928388a3c5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1681 microversion: 2.1 time: 0.148105 Jul 29 14:42:12.689566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 356/719] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:12 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:12.733808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:12.734418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:12.740314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.740764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:12.741561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.742000 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:12.866686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:12.874014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6df20aa8-4b2e-460b-81dd-a7fbcc6993a4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.144058 Jul 29 14:42:12.874574 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 364/720] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:12 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:12.967368 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:12.967978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:12.974741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.975189 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:12.975981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:12.976416 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:13.121519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:13.129557 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0bb141a1-2c64-42b3-b890-aa938bbfa79e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.165982 Jul 29 14:42:13.130116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 357/721] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:12 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:13.712325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:13.712925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:13.718918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:13.719363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:13.720113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:13.720545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:13.850351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:13.857931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-eb568d38-37f3-4a78-a01e-ad1626f64726 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1681 microversion: 2.1 time: 0.149442 Jul 29 14:42:13.858491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 365/722] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:13 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:13.895362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:13.895975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:13.902777 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:13.903229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:13.904008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:13.904447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:14.037315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:14.044921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4a8bab5e-426b-4688-acae-5977c082e521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.153384 Jul 29 14:42:14.045519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 358/723] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:13 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:14.150893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:14.151565 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:14.157679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:14.158131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:14.158913 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:14.159352 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:14.422693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:14.431880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c480c4c8-ff2f-4de5-9783-fb1d0b66e18c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.284870 Jul 29 14:42:14.432802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 366/724] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:14 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:14.881413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:14.882202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:14.890060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:14.890260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:14.891444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:14.891444 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:14.957937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:14.965715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-84c4074a-4027-4a78-bb31-fe8b3969f848 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1613 microversion: 2.1 time: 0.089649 Jul 29 14:42:14.977750 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 359/725] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:14 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1613 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:14.992927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-67f617e5-63f4-47ac-82ff-323ec4191104 req-f8439666-5296-4a06-bfe5-36793c2c400a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1b03f71-e979-45c1-a50f-40bbb4ef2bad", "name": "network-vif-deleted", "tag": "7060ed6b-4d5a-4aaa-8f19-12fac0218ffd"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:15.002539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-67f617e5-63f4-47ac-82ff-323ec4191104 req-f8439666-5296-4a06-bfe5-36793c2c400a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.002993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-67f617e5-63f4-47ac-82ff-323ec4191104 req-f8439666-5296-4a06-bfe5-36793c2c400a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.015630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-67f617e5-63f4-47ac-82ff-323ec4191104 req-f8439666-5296-4a06-bfe5-36793c2c400a service nova] Creating event network-vif-deleted:7060ed6b-4d5a-4aaa-8f19-12fac0218ffd for instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad on hv-cinder-79987 Jul 29 14:42:15.020806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-67f617e5-63f4-47ac-82ff-323ec4191104 req-f8439666-5296-4a06-bfe5-36793c2c400a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103014 Jul 29 14:42:15.021750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 367/726] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:42:15.067974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:15.068613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:15.076851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.078236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.078236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.078531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.232050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:15.241679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ee993894-3d74-4f5f-b589-82ea9d9b0521 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.178165 Jul 29 14:42:15.242319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 360/727] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:15 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:15.454036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:15.454862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:15.461724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.462186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.462962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.463411 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.622258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:15.632965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4ab96ac5-e873-449e-9459-0738a75098ec tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.183038 Jul 29 14:42:15.634128 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 368/728] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:15 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:15.989546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:15.990333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:15.996613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.997216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:15.998287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:15.998955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.031107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:16.031711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.032277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'fault' on Instance uuid e1b03f71-e979-45c1-a50f-40bbb4ef2bad {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:16.079733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:16.083928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:16.088851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c159092c-379b-4b2d-b42b-cced3edb2e0a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 200 len: 1331 microversion: 2.1 time: 0.103901 Jul 29 14:42:16.089793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 361/729] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:15 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:16.263693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:16.264468 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:16.271455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:16.271996 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.272846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:16.273376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.406407 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:16.414430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e84d4de9-ca14-4a23-964a-5a04859ff7ed tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.154628 Jul 29 14:42:16.414998 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 369/730] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:16 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:16.656352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:16.657045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:16.663743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:16.664186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.664973 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:16.665429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:16.816607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:16.824710 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8660eda3-2a6b-41ae-b481-1aa002f8c32e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1756 microversion: 2.1 time: 0.172662 Jul 29 14:42:16.825297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 362/731] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:16 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:17.110753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:17.111399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:17.117844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.118299 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:17.119071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.119513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:17.134643 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad HTTP/1.1 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:42:17.136266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:42:17.137887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': 'e1b03f71-e979-45c1-a50f-40bbb4ef2bad'} Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:42:17.138741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:42:17.140180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:17.141537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:42:17.141537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dc95173f-83e1-495b-9c63-28a44ff36e9e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 404 len: 111 microversion: 2.1 time: 0.030857 Jul 29 14:42:17.141537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 370/732] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:17 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:42:17.146839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-80903b30-523e-460f-ac40-6a731d3dc23d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '.version_select at 0x7f681013e310>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:17.258070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-80903b30-523e-460f-ac40-6a731d3dc23d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-942758086" status: 202 len: 0 microversion: 2.1 time: 0.115097 Jul 29 14:42:17.258634 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 363/733] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 14:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-942758086 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:17.436327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:17.437098 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:17.444613 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.445112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:17.445908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.446351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:17.580925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:17.588463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-58fa2f2f-8af3-4066-a550-787a617c4d59 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.156582 Jul 29 14:42:17.589042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 371/734] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:17 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:17.846511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:17.847213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:17.854740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.855264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:17.859105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:17.859105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.291937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:18.303287 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c1307ce8-fd58-4fbd-9e83-aa3c36ab1f27 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1759 microversion: 2.1 time: 0.460852 Jul 29 14:42:18.304292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 364/735] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:17 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1759 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:18.359214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:18.359749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:18.366214 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.366876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.367645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.368078 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.449093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'services' on Instance uuid 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:18.610150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:18.610765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:18.616820 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.617296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.618097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.618534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.694986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-89083dac-4cb5-47c7-b1d3-e1fbd48a7391 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments/fcefe0a0-b458-45d1-9f8d-07f79e398b82" status: 202 len: 0 microversion: 2.1 time: 0.339342 Jul 29 14:42:18.695614 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 372/736] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:42:18 2022] DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments/fcefe0a0-b458-45d1-9f8d-07f79e398b82 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:18.704609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:18.708075 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:18.715200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.715650 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.716429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:18.716882 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:18.747753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e00bd597-0afa-4489-b48f-d23c5689278b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047342 Jul 29 14:42:18.748311 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 373/737] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:42:18 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:42:18.754241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:18.761819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2cd49cb8-102d-4e0b-9274-b555db18083a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.155828 Jul 29 14:42:18.762378 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 365/738] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:18 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:19.760664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:19.762929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:19.769320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:19.769773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:19.770570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:19.771009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:19.782922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:19.783682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:19.790420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:19.790875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:19.791647 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:19.792083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:19.799862 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-be44a901-ac36-4e54-bb5f-5de1f357bd30 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Jul 29 14:42:19.801228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 374/739] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:42:19 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:19.924534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:19.933597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-920e292e-e57e-4ca0-8cc3-f8c38510a2c4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.154443 Jul 29 14:42:19.934167 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 366/740] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:19 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:20.812979 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:20.815157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:20.821844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.822291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.823047 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.823493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.852985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aa2c70d2-fca7-4ab8-8695-965c7ad4be2a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044065 Jul 29 14:42:20.853555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 375/741] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:42:20 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:42:20.914197 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:20.914674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:20.921040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.921489 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.922241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.922671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.947148 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:42:20.955154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:20.955754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:20.962719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.962875 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.963535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:20.963963 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:20.968008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:21.099367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:21.106801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f349efa-c287-4fb4-bd13-89074615a5cc tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.155489 Jul 29 14:42:21.107366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 376/742] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:20 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:21.228597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-59319db4-d53a-48f3-be1a-e11c2a64f695 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 204 len: 0 microversion: 2.1 time: 0.317899 Jul 29 14:42:21.229228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 367/743] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:42:20 2022] DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 14:42:21.237427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:21.238664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:21.244672 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:21.246562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:21.246562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:21.246562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:21.371517 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:21.378888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c3c5f39d-4f25-4b78-9ea2-ba5dc2adc1df tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1679 microversion: 2.1 time: 0.145343 Jul 29 14:42:21.379445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 377/744] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:21 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1679 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:22.128223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:22.129628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:22.136142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:22.136596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:22.137389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:22.137832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:22.176396 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:42:22.176968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:42:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:42:22.268482 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:22.275926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-83d5ec79-e8a5-4ffe-8bd4-cc8a14f9670b tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1678 microversion: 2.1 time: 0.152031 Jul 29 14:42:22.276713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 368/745] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:22 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:22.399911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:22.400522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:22.407315 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:22.407805 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:22.408580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:22.409095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:22.646995 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:22.654764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-202d82d5-3264-413f-8de4-4c080eeda31c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1679 microversion: 2.1 time: 0.258751 Jul 29 14:42:22.655334 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 378/746] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:22 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1679 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:23.217478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-ad9f83b1-5092-4e54-b148-68ea752522b5 req-f3b13509-8923-445b-8b57-e81162ec379f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae", "name": "network-vif-deleted", "tag": "abe28195-9569-4a0d-a8af-38b76a84cda8"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:23.229461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ad9f83b1-5092-4e54-b148-68ea752522b5 req-f3b13509-8923-445b-8b57-e81162ec379f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.229918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ad9f83b1-5092-4e54-b148-68ea752522b5 req-f3b13509-8923-445b-8b57-e81162ec379f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.241948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-ad9f83b1-5092-4e54-b148-68ea752522b5 req-f3b13509-8923-445b-8b57-e81162ec379f service nova] Creating event network-vif-deleted:abe28195-9569-4a0d-a8af-38b76a84cda8 for instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae on hv-cinder-79987 Jul 29 14:42:23.247248 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-ad9f83b1-5092-4e54-b148-68ea752522b5 req-f3b13509-8923-445b-8b57-e81162ec379f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033379 Jul 29 14:42:23.247856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 369/747] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:23.297976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:23.299264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:23.309829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.312768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.312768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.312768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.451653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:23.468764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-05e377f1-9c27-4573-a80d-be6c6a967a32 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1655 microversion: 2.1 time: 0.175308 Jul 29 14:42:23.478547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 379/748] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:23 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1655 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:23.491680 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3d7a001a-8ac6-4dd8-8cbd-e19c481b8650 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:23.498401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d7a001a-8ac6-4dd8-8cbd-e19c481b8650 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.498933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3d7a001a-8ac6-4dd8-8cbd-e19c481b8650 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.521450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3d7a001a-8ac6-4dd8-8cbd-e19c481b8650 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Going to try to start instance {{(pid=124772) start /opt/stack/nova/nova/compute/api.py:2732}} Jul 29 14:42:23.677901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:23.678478 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:23.684392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.684846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.685698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.686112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.698257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3d7a001a-8ac6-4dd8-8cbd-e19c481b8650 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action" status: 202 len: 0 microversion: 2.1 time: 0.211620 Jul 29 14:42:23.706224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 370/749] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:42:23 2022] POST /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:23.710731 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:23.711709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:23.719101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.719553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.720012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'fault' on Instance uuid 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:23.720426 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.720871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.721668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:23.722724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:23.765373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:23.774129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-98132b79-3201-4a94-8716-9fc5f0fa08bb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 200 len: 1331 microversion: 2.1 time: 0.100680 Jul 29 14:42:23.774975 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 380/750] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:23 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:23.864493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:23.872240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1e929a31-14af-4ed1-8fdd-bec988ee5994 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1664 microversion: 2.1 time: 0.168238 Jul 29 14:42:23.872826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 371/751] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:23 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1664 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:24.795639 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:24.796246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:24.803661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:24.804108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:24.804887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:24.805454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:24.818991 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae HTTP/1.1 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:42:24.820625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:42:24.822134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae'} Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:42:24.823017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:42:24.824237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:42:24.825372 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:42:24.825372 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aac38d2e-d3b9-4ce7-a8b6-fcb2725618f6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 404 len: 111 microversion: 2.1 time: 0.030313 Jul 29 14:42:24.825372 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 381/752] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:24 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:42:24.831608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b8b025f7-d551-45b0-a829-23bdc0377ef1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '.version_select at 0x7f6803f5bd30>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:24.893519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:24.894124 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:24.900514 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:24.900971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:24.901768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:24.902280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:24.913948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b8b025f7-d551-45b0-a829-23bdc0377ef1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999437859" status: 202 len: 0 microversion: 2.1 time: 0.086108 Jul 29 14:42:24.914589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 372/753] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 14:42:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1999437859 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:42:25.037026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:25.044773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-59b519db-adc5-495a-9ed1-178b829d957c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1664 microversion: 2.1 time: 0.155494 Jul 29 14:42:25.045355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 382/754] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:24 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:25.655454 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5314604e-7c2f-4c2d-ae09-143a9dce9a2b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: .version_select at 0x7f6810249c10>, body: {"keypair": {"name": "tempest-keypair-951729339", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHMlKoKesRxcpJhBOXpZN4MP4N9fylK+uQsn82AiTtQ2W+EEkuPdf55SJRs1b+zvTzN499F/R9GamYJoQFFGMWEUHtJgKHqDyM2YOWdKnWTvsvlCWWL2REEvUNbnTlrpnQ=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:25.671498 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-5314604e-7c2f-4c2d-ae09-143a9dce9a2b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:42:25.675724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-5314604e-7c2f-4c2d-ae09-143a9dce9a2b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:42:25.743920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5314604e-7c2f-4c2d-ae09-143a9dce9a2b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.092419 Jul 29 14:42:25.744510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 373/755] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:42:25 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:26.067551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:26.068171 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:26.074801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:26.075258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:26.076164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:26.076596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:26.209569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:26.216943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f47f9f3c-fc49-4490-b212-b33a36c191c0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1668 microversion: 2.1 time: 0.154130 Jul 29 14:42:26.217533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 383/756] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:26 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:27.834981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-459079485", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b59a034-1f9b-4894-a9bb-b8f2d507494e"}], "security_groups": [{"name": "tempest-securitygroup--1961715658"}], "key_name": "tempest-keypair-951729339", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:27.936605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] validate_networks() for [('5b59a034-1f9b-4894-a9bb-b8f2d507494e', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:42:28.344511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:42:28.344932 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:42:28.345445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:42:28.345907 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:42:28.346323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:42:28.355771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:28.356222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:28.357097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:28.357538 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:28.374487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:42:28.378925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:42:28.389726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:42:28.391990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:42:28.516428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8ffd207f-8cd3-41eb-92e6-a1c0158a8941 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.686472 Jul 29 14:42:28.517101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 374/757] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:42:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:42:28.529536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-319e13e4-a7f8-46d6-9895-ee3eaabc212e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:28.529536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-319e13e4-a7f8-46d6-9895-ee3eaabc212e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:28.588452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-319e13e4-a7f8-46d6-9895-ee3eaabc212e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:28.595135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-319e13e4-a7f8-46d6-9895-ee3eaabc212e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1240 microversion: 2.1 time: 0.070269 Jul 29 14:42:28.595637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 384/758] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:28 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:29.616677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:29.617321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:29.623974 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:29.624420 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:29.625230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:29.625666 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:29.686699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:29.694920 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-89af08f2-cb97-46d0-a338-8002f494d18d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1244 microversion: 2.1 time: 0.083099 Jul 29 14:42:29.695411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 375/759] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:29 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:30.715526 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:30.716406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:30.723706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:30.724141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:30.724909 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:30.725371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:30.802187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:30.809800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-01636643-a4d7-4d52-a359-dc8f4b0832b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1300 microversion: 2.1 time: 0.098159 Jul 29 14:42:30.810374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 385/760] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:30 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:31.830887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:31.831506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:31.838638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:31.839092 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:31.839864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:31.840304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:31.987256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:31.995996 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1bf0b74b-bd69-4ac3-9926-1b8a2154f26c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.168939 Jul 29 14:42:31.996554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 376/761] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:31 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:32.156449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-632762bc-75e7-4019-82fd-a633070a6464 req-2d81a1af-b0c8-43a2-86e1-d28cd3a493c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6d02d4-eb24-41e9-b261-4ba55250bf1d", "tag": "6fb007ce-b3f6-42ce-9f27-2522151054f4"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:32.167704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-632762bc-75e7-4019-82fd-a633070a6464 req-2d81a1af-b0c8-43a2-86e1-d28cd3a493c8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:32.168154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-632762bc-75e7-4019-82fd-a633070a6464 req-2d81a1af-b0c8-43a2-86e1-d28cd3a493c8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:32.180512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-632762bc-75e7-4019-82fd-a633070a6464 req-2d81a1af-b0c8-43a2-86e1-d28cd3a493c8 service nova] Creating event network-changed:6fb007ce-b3f6-42ce-9f27-2522151054f4 for instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d on hv-cinder-79987 Jul 29 14:42:32.185500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-632762bc-75e7-4019-82fd-a633070a6464 req-2d81a1af-b0c8-43a2-86e1-d28cd3a493c8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032744 Jul 29 14:42:32.186089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 386/762] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:33.018339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:33.019060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:33.027087 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:33.027463 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:33.028255 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:33.028696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:33.158576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:33.166598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad3e044b-f0f6-41fa-b90e-aaf6e0c85256 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.152081 Jul 29 14:42:33.167159 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 377/763] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:33 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:34.189009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:34.189712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:34.195912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:34.196359 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:34.197160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:34.197599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:34.328317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:34.336248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aaff14a8-02de-4cde-b3b1-795e8c010074 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.151903 Jul 29 14:42:34.336802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 387/764] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:34 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:35.357487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:35.358139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:35.364664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:35.365158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:35.365931 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:35.366371 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:35.496223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:35.503472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3508b360-90e6-4fb3-af55-70dc2ac9d7f7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.149797 Jul 29 14:42:35.504025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 378/765] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:35 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:36.387724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:36.388234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:36.395251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.396010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.396777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.397358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.425816 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e438279-fb6d-4a75-9f01-73d9fd43f6d3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments/4d9c7e2a-d108-4aa2-ae73-1a73e1422433" status: 200 len: 194 microversion: 2.20 time: 0.042117 Jul 29 14:42:36.426415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 388/766] 10.222.0.49 () {60 vars in 1454 bytes} [Fri Jul 29 14:42:36 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments/4d9c7e2a-d108-4aa2-ae73-1a73e1422433 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:42:36.493918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:36.494409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:36.500774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.501257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.502024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.502461 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.524098 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:36.524803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:36.530824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.531277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.532052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.532493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.588212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lazy-loading 'services' on Instance uuid d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:36.591772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:36.664413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:36.671869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6be53d77-aa76-45aa-ae2b-8e24d44a4814 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.152200 Jul 29 14:42:36.672434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 389/767] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:36 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:36.784362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0e142cb4-ffc2-4ce8-bc6b-4982492bb0a9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments/4d9c7e2a-d108-4aa2-ae73-1a73e1422433" status: 202 len: 0 microversion: 2.20 time: 0.294195 Jul 29 14:42:36.784956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 379/768] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Jul 29 14:42:36 2022] DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments/4d9c7e2a-d108-4aa2-ae73-1a73e1422433 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 29 14:42:36.793819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:36.796003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:36.803178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.803661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.804437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:36.804873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:36.833754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-392e3007-3144-4a87-9478-672675fd8a17 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043813 Jul 29 14:42:36.834303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 390/769] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 14:42:36 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:42:37.694544 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:37.695174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:37.701434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:37.701885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:37.702762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:37.703146 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:37.836121 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:37.843648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-285b57f1-a5fd-43a1-b4f9-9f89a47d5eb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.154652 Jul 29 14:42:37.844208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 380/770] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:37 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:37.846461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:37.848774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:37.855336 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:37.855784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:37.856549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:37.856985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:37.886286 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4aaf5892-6e51-43e9-8605-c5dd8e8fb01e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043916 Jul 29 14:42:37.886834 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 391/771] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 14:42:37 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:42:38.864400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:38.865151 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:38.867129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:38.867804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=10 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:38.873140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:38.873591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:38.877218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:38.877218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:38.898832 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:38.905869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:38.905869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:38.907992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:38.908444 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:38.909281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:38.909723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:38.938873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-73f9b2d6-f8ca-4daf-bc39-7527733bcec8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044771 Jul 29 14:42:38.939430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 392/772] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 14:42:38 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:42:39.004664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:39.005700 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:39.011887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:39.012224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:39.012347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:39.013100 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:39.013538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:39.020512 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b3fcf664-1bf4-44c1-88d4-4d7c7679adb9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.159541 Jul 29 14:42:39.021458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 381/773] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:38 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:39.039323 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:42:39.072207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:39.331171 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-774a4ba7-4af2-4871-a537-93b1a1a18466 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 204 len: 0 microversion: 2.20 time: 0.331097 Jul 29 14:42:39.331761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 393/774] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 14:42:38 2022] DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 14:42:39.339989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:39.340602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:39.346510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:39.346959 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:39.347718 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:39.348302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:39.477242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:39.485261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:39.486815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:39.487914 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-15820aad-dd02-49e9-ba2e-054c79496c76 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.151812 Jul 29 14:42:39.489114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 382/775] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:39 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:42:39.646702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-69fb646e-0443-4e85-abe5-b550763e7ea5 req-9b136b4a-66cf-486e-bd8b-16f843f6c80c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6d02d4-eb24-41e9-b261-4ba55250bf1d", "name": "network-vif-plugged", "status": "completed", "tag": "6fb007ce-b3f6-42ce-9f27-2522151054f4"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:39.656155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-69fb646e-0443-4e85-abe5-b550763e7ea5 req-9b136b4a-66cf-486e-bd8b-16f843f6c80c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:39.656618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-69fb646e-0443-4e85-abe5-b550763e7ea5 req-9b136b4a-66cf-486e-bd8b-16f843f6c80c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:39.667941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-69fb646e-0443-4e85-abe5-b550763e7ea5 req-9b136b4a-66cf-486e-bd8b-16f843f6c80c service nova] Creating event network-vif-plugged:6fb007ce-b3f6-42ce-9f27-2522151054f4 for instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d on hv-cinder-79987 Jul 29 14:42:39.673264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-69fb646e-0443-4e85-abe5-b550763e7ea5 req-9b136b4a-66cf-486e-bd8b-16f843f6c80c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094028 Jul 29 14:42:39.673827 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 394/776] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:40.043705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:40.044326 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:40.051131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:40.051584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:40.052382 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:40.052826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:40.182208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:40.189486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2845e0b3-b0a4-49c0-81ab-51fc9a05cafe tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.149737 Jul 29 14:42:40.190044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 383/777] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:40 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:40.512285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:40.512911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:40.519618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:40.520066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:40.520859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:40.521974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:40.649106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:40.656891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:40.658415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:40.659586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd52bba7-944a-46dc-ad7c-43b78255e2bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.151630 Jul 29 14:42:40.660128 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 395/778] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:40 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:42:41.210359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:41.210970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:41.217682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:41.218071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:41.218840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:41.219275 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:41.353783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:41.361016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6296a5dd-f5f9-4366-9200-9156e69e6cc9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.154635 Jul 29 14:42:41.361586 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 384/779] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:41 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:41.682971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:41.683570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:41.686021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:41.691185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:41.691631 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:41.692397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:41.692831 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:41.949691 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:41.963661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:41.965403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:41.969687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d32e8ebe-c3a8-4d0d-8b4d-7a2d2f26373d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1724 microversion: 2.20 time: 0.287479 Jul 29 14:42:41.969687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 396/780] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:41 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:42.383417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:42.383852 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:42.385972 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:42.390730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:42.391169 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:42.391929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:42.392356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:42.525604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:42.532967 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-645b07c1-1af2-4ace-8ec2-aef7bc6c8f86 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.154245 Jul 29 14:42:42.533553 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 385/781] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:42 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:42.632354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-1e05f766-0a0a-4a14-95a9-3ae74152dd91 req-edc5885a-03ab-401d-aa2a-4ae5f87cc30f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0ff1ddf-dd46-49f7-a6d8-cfacc188c464", "name": "network-vif-deleted", "tag": "806294c4-29d1-4ca5-b556-18b026f53ae3"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:42.641556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-1e05f766-0a0a-4a14-95a9-3ae74152dd91 req-edc5885a-03ab-401d-aa2a-4ae5f87cc30f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:42.641999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-1e05f766-0a0a-4a14-95a9-3ae74152dd91 req-edc5885a-03ab-401d-aa2a-4ae5f87cc30f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:42.653226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-1e05f766-0a0a-4a14-95a9-3ae74152dd91 req-edc5885a-03ab-401d-aa2a-4ae5f87cc30f service nova] Creating event network-vif-deleted:806294c4-29d1-4ca5-b556-18b026f53ae3 for instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 on hv-cinder-79987 Jul 29 14:42:42.658071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-1e05f766-0a0a-4a14-95a9-3ae74152dd91 req-edc5885a-03ab-401d-aa2a-4ae5f87cc30f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030153 Jul 29 14:42:42.658656 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 397/782] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:42.989111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:42.989636 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:42.996878 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:42.997352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:42.998120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:42.998555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:43.063245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:43.072470 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:43.077612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:43.077612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-52bb3099-892b-4df2-8f95-ccda47277595 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1656 microversion: 2.20 time: 0.090028 Jul 29 14:42:43.077612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 386/783] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:42 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:43.556249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:43.556859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:43.563068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:43.563521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:43.564292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:43.564726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:43.699844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:43.707318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e667a7f5-5bb4-45a2-84f2-882bc93da9a7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1366 microversion: 2.1 time: 0.156586 Jul 29 14:42:43.707884 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 398/784] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:43 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:44.098006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:44.098629 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:44.105410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:44.105870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:44.106644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:44.107086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:44.137818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:44.138219 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:44.138670 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lazy-loading 'fault' on Instance uuid d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:42:44.182772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:44.190685 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:44.192198 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:44.194270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d2ef0237-9b2d-4d4f-a7a7-992fda0a4da0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 200 len: 1371 microversion: 2.20 time: 0.099225 Jul 29 14:42:44.194830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 387/785] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:44 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:44.727986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:44.728600 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:44.734768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:44.735216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:44.735988 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:44.736423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:45.207111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:45.215203 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-64b34fd0-3fa6-43e9-8db0-e050a82ae0f5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1555 microversion: 2.1 time: 0.491370 Jul 29 14:42:45.221906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 399/786] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:42:44 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1555 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:42:45.222105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:45.222105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:45.225858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:45.226511 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:45.227453 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:45.228041 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:45.237576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:45.238176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:45.242644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 HTTP/1.1 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:42:45.244499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:42:45.246123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'd0ff1ddf-dd46-49f7-a6d8-cfacc188c464'} Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:42:45.247021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:42:45.248295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:42:45.249539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:45.249539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:45.249539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:45.249999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:45.250391 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:42:45.251248 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f029c8be-7043-4ad5-b9f0-75ba63d2044c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 404 len: 111 microversion: 2.20 time: 0.037552 Jul 29 14:42:45.255190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 388/787] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:45 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 14:42:45.260921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-12ee78c2-c46b-4be2-81e1-825e2750769d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '.version_select at 0x7f681008bee0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:45.344233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-12ee78c2-c46b-4be2-81e1-825e2750769d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972198051" status: 204 len: 0 microversion: 2.20 time: 0.087156 Jul 29 14:42:45.344816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 389/788] 10.222.0.49 () {60 vars in 1262 bytes} [Fri Jul 29 14:42:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972198051 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 29 14:42:45.365393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8051b53c-f9f3-4475-a0b3-810fef7bd8a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131739 Jul 29 14:42:45.366381 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 400/789] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:42:45 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:46.128752 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1c6f7199-d9d7-4e9c-a88d-4809e80bcd20 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: .version_select at 0x7f6803f5b8b0>, body: {"keypair": {"name": "tempest-keypair-1804151451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwkH6KXB74KO8bO6EJ4AqbOnaTVufGno0c+8VKNAhqW6MuMuZOXhj8haBHiHYenEOtEsa0Bh0wh6W6VZa+eke+fQVaPwqVOtON0DiRhoTtGvQ+kqaLRMy2a8fb10JEVww=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:46.149782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-1c6f7199-d9d7-4e9c-a88d-4809e80bcd20 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:42:46.155953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-1c6f7199-d9d7-4e9c-a88d-4809e80bcd20 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for user de769d721b8b49c6a5d7d391412da122 and project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:42:46.250253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1c6f7199-d9d7-4e9c-a88d-4809e80bcd20 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.125834 Jul 29 14:42:46.257176 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 390/790] 10.222.0.49 () {62 vars in 1200 bytes} [Fri Jul 29 14:42:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 127 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 29 14:42:46.535791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-eb4e33d4-b7bb-4fec-8d29-81826abe9a88 req-0ac18150-05cb-4799-a3bf-90104bb7e95e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e6d02d4-eb24-41e9-b261-4ba55250bf1d", "tag": "6fb007ce-b3f6-42ce-9f27-2522151054f4"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:46.545800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-eb4e33d4-b7bb-4fec-8d29-81826abe9a88 req-0ac18150-05cb-4799-a3bf-90104bb7e95e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:46.546241 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-eb4e33d4-b7bb-4fec-8d29-81826abe9a88 req-0ac18150-05cb-4799-a3bf-90104bb7e95e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:46.558217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-eb4e33d4-b7bb-4fec-8d29-81826abe9a88 req-0ac18150-05cb-4799-a3bf-90104bb7e95e service nova] Creating event network-changed:6fb007ce-b3f6-42ce-9f27-2522151054f4 for instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d on hv-cinder-79987 Jul 29 14:42:46.564736 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-eb4e33d4-b7bb-4fec-8d29-81826abe9a88 req-0ac18150-05cb-4799-a3bf-90104bb7e95e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032905 Jul 29 14:42:46.568315 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 401/791] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:48.459343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1612210903", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3321aef9-3db9-44ad-a3ca-b4fe8a59d185"}], "security_groups": [{"name": "tempest-securitygroup--551984933"}], "key_name": "tempest-keypair-1804151451", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:48.561283 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] validate_networks() for [('3321aef9-3db9-44ad-a3ca-b4fe8a59d185', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:42:48.921052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:42:48.921507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:42:48.922003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:42:48.922439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:42:48.922848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:42:48.933349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:48.933799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:48.934597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:48.935028 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:48.951910 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:42:48.955767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Getting quotas for user de769d721b8b49c6a5d7d391412da122 and project fdbc49e630fc461a858eb04c2dd52a82. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:42:48.966728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:42:48.968937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:42:49.095725 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-39b47a75-bcb5-4e61-a274-cd4960e29607 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.640893 Jul 29 14:42:49.096367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 391/792] 10.222.0.49 () {62 vars in 1188 bytes} [Fri Jul 29 14:42:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 29 14:42:49.108569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:49.109534 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:49.164049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:49.171382 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:49.172895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:49.174057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d6aec070-e6cf-41f4-bd25-cc26cfb48180 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1282 microversion: 2.20 time: 0.070579 Jul 29 14:42:49.174872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 402/793] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:49 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1282 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:50.197662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:50.198303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:50.204242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:50.204684 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:50.205483 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:50.205915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:50.267574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:50.276440 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:50.277963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:50.279104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-677a658e-0fd7-4b54-98a8-e3e2aaf26645 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1278 microversion: 2.20 time: 0.085940 Jul 29 14:42:50.279652 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 392/794] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:50 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:51.302348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:51.303051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:51.310432 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:51.310883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:51.311652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:51.312088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:51.384763 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:51.392801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:51.394362 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:51.395465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d8e8a669-28a5-4acb-9fdd-87d57859317e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1352 microversion: 2.20 time: 0.097272 Jul 29 14:42:51.396025 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 403/795] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:51 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1352 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:42:52.418481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:52.419089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:52.425886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:52.429570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:52.429570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:52.429570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:52.563865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:52.572641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:52.574194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:52.575294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-28225772-8f03-45f1-b7a9-20eecd6e2ee2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.160665 Jul 29 14:42:52.575853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 393/796] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:52 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:52.776353 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d3d8d652-12db-4c51-9536-daf14095c56a req-aea41778-d791-4d13-a65e-3dce0b4a8e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:42:52.786308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d3d8d652-12db-4c51-9536-daf14095c56a req-aea41778-d791-4d13-a65e-3dce0b4a8e5d service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:52.792012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d3d8d652-12db-4c51-9536-daf14095c56a req-aea41778-d791-4d13-a65e-3dce0b4a8e5d service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:52.797651 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d3d8d652-12db-4c51-9536-daf14095c56a req-aea41778-d791-4d13-a65e-3dce0b4a8e5d service nova] Creating event network-changed:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:42:52.802914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d3d8d652-12db-4c51-9536-daf14095c56a req-aea41778-d791-4d13-a65e-3dce0b4a8e5d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030436 Jul 29 14:42:52.804130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 404/797] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:42:53.598478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:53.603276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:53.605771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:53.606218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:53.607021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:53.607457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:53.739646 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:53.748237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:53.749783 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:53.750911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3b7d69f1-aa93-430b-9d5e-373a2367ef3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.156320 Jul 29 14:42:53.751451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 394/798] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:53 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:54.775563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:54.776244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:54.782354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:54.782803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:54.783554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:54.783986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:54.909804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:54.918194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:54.919681 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:54.920779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f96b0867-3d24-448f-b0a3-b7854aba1ae3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.150545 Jul 29 14:42:54.921420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 405/799] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:54 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:55.943449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:55.944957 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:55.951447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:55.951929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:55.952691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:55.953173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:56.089918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:56.097823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:56.099328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:56.100960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1c07ceb8-3bad-49a7-b24c-fcc9386f79cd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.161635 Jul 29 14:42:56.101537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 395/800] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:55 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:57.123239 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:57.123840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:57.130261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:57.130701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:57.132061 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:57.132570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:57.264445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:57.272322 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:57.273826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:57.274910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5c2c3a77-cb13-436d-aea0-10a7d9fb1bae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.155550 Jul 29 14:42:57.275464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 406/801] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:57 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:58.296521 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:58.297168 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:58.304689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:58.305174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:58.305943 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:58.306378 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:58.433850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:58.442031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:58.443603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:58.444917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-741b2b23-b059-4be4-a8c1-5c9be0f092c9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.152333 Jul 29 14:42:58.445624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 396/802] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:58 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:42:59.467277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:42:59.467884 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:42:59.470362 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:42:59.475266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:59.475609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:59.476376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:42:59.476810 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:42:59.603508 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:59.611689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:59.613165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:42:59.614268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-27e062ff-d06a-43f6-9b5f-210abc1a2658 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.150944 Jul 29 14:42:59.614817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 407/803] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:42:59 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:43:00.056654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-b9094856-9436-45ed-8dc6-1804cdf7ca62 req-3129aa27-05e2-4a27-b1f4-620ef513351d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "name": "network-vif-plugged", "status": "completed", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:00.061861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:00.062564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=10 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:00.069055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-b9094856-9436-45ed-8dc6-1804cdf7ca62 req-3129aa27-05e2-4a27-b1f4-620ef513351d service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:00.069507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-b9094856-9436-45ed-8dc6-1804cdf7ca62 req-3129aa27-05e2-4a27-b1f4-620ef513351d service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:00.080263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-b9094856-9436-45ed-8dc6-1804cdf7ca62 req-3129aa27-05e2-4a27-b1f4-620ef513351d service nova] Creating event network-vif-plugged:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:43:00.085674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-b9094856-9436-45ed-8dc6-1804cdf7ca62 req-3129aa27-05e2-4a27-b1f4-620ef513351d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033722 Jul 29 14:43:00.086290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 397/804] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:00.638257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:00.638937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:00.645777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:00.646221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:00.647629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:00.648101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:00.841403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:00.849265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:00.850780 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:00.851946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e756f7a2-aa0a-4fbf-8177-36d6e90723cb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.217707 Jul 29 14:43:00.852511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 408/805] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:43:00 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:43:01.875465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:01.876160 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:01.884171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:01.884893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:01.885696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:01.886134 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:02.015141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:02.023225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:02.024740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:02.025888 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9c24daa9-c4b7-43f9-b1e2-78d732164e03 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.155160 Jul 29 14:43:02.026441 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 398/806] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:43:01 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:43:02.527101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:02.527629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:02.534064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:02.534519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:02.535291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:02.535730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:02.616400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'services' on Instance uuid d9feeb90-af89-4905-8830-d88a13334f0a {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:43:02.812431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-485cbd29-afc8-407d-a4da-0b89844082ab tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments/d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3" status: 202 len: 0 microversion: 2.1 time: 0.289079 Jul 29 14:43:02.813026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 409/807] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:43:02 2022] DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments/d2a3a7c2-e925-4f05-bc4c-f4651b31a1f3 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:02.821850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:02.824009 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:02.830071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:02.830589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:02.831355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:02.831793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:02.856569 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:02.860948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e7327405-6bdd-48bc-bb92-0ecec282168e tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043572 Jul 29 14:43:02.861517 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 399/808] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:02 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:03.049835 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:03.050630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:03.057875 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:03.058326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:03.059091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:03.059525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:03.346301 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:03.354813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:03.356349 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:03.357477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-91e254b5-32e7-4b1f-871e-b2da97fd5258 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1407 microversion: 2.20 time: 0.312347 Jul 29 14:43:03.362136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 410/809] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:43:03 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1407 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:43:03.873446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:03.875575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:03.883370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:03.883821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:03.884591 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:03.885055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:03.913869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-66129f1a-de7d-4113-befb-b2dfaa3773e1 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Jul 29 14:43:03.914435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 400/810] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:03 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:04.379675 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:04.385093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:04.387021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.387483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.388260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.388734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.518110 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:04.526197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:04.527683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:04.528824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e539fda9-db03-42d8-8601-25baec74d8c8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1600 microversion: 2.20 time: 0.153090 Jul 29 14:43:04.529397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 411/811] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:43:04 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:43:04.551806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:04.553657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:04.558909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.559354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.560119 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.560555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.640267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-56ee46ad-6f2f-419c-ac7e-4c953017d208 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092944 Jul 29 14:43:04.640854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 401/812] 10.222.0.49 () {60 vars in 1316 bytes} [Fri Jul 29 14:43:04 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:43:04.926431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:04.931300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:04.935477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.935915 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.936684 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:04.937142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:04.966141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ed6f27bd-c139-43e6-806e-94d3e90e387f tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043880 Jul 29 14:43:04.966688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 412/813] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:04 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:43:05.049472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:05.050075 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:05.057960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:05.058528 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:05.059394 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:05.059838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:05.090187 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:05.510634 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9aeff73b-1cd9-4db3-a1fc-be2ef2bd88f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 204 len: 0 microversion: 2.1 time: 0.465461 Jul 29 14:43:05.511223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 402/814] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:05 2022] DELETE /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:05.518983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:05.519596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:05.526629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:05.527073 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:05.527848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:05.528287 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:05.532456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:05.662730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:05.670276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e72db632-00ac-40e9-af5e-a2a3dc5d55c8 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1689 microversion: 2.1 time: 0.155043 Jul 29 14:43:05.670857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 413/815] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:05 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:05.829679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-c4dff2b9-4b75-48c1-870e-2e25b936fd6c req-2af6a7d5-154e-4cd8-a6ab-a3555b126dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:05.839251 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c4dff2b9-4b75-48c1-870e-2e25b936fd6c req-2af6a7d5-154e-4cd8-a6ab-a3555b126dec service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:05.839697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c4dff2b9-4b75-48c1-870e-2e25b936fd6c req-2af6a7d5-154e-4cd8-a6ab-a3555b126dec service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:05.850273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-c4dff2b9-4b75-48c1-870e-2e25b936fd6c req-2af6a7d5-154e-4cd8-a6ab-a3555b126dec service nova] Creating event network-changed:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:43:05.855769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-c4dff2b9-4b75-48c1-870e-2e25b936fd6c req-2af6a7d5-154e-4cd8-a6ab-a3555b126dec service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Jul 29 14:43:05.856480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 403/816] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:06.691698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:06.692369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:06.699775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:06.700254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:06.701066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:06.701518 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:06.830951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:06.838414 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-429dc2a7-57b7-4abd-9e1f-33ef27cf0dd6 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1689 microversion: 2.1 time: 0.150567 Jul 29 14:43:06.838974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 414/817] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:06 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1689 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:07.860184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:07.860904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:07.868132 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:07.868577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:07.869380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:07.869818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:08.002046 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:08.010508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9ba64de4-12e8-48be-a9e7-acd6c5803a68 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1689 microversion: 2.1 time: 0.154421 Jul 29 14:43:08.011069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 404/818] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:07 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:09.031897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:09.032528 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:09.039107 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:09.039545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:09.040307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:09.040744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:09.167033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:09.174952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f2895807-f51b-41f2-94e3-74e78bac313c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1689 microversion: 2.1 time: 0.147056 Jul 29 14:43:09.175515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 415/819] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:09 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1689 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:10.195866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:10.196476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:10.203110 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:10.203561 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:10.204340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:10.204778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:10.336584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:10.344006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ebaa37da-36c6-4347-8930-5efb083e81aa tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1689 microversion: 2.1 time: 0.152215 Jul 29 14:43:10.344560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 405/820] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:10 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1689 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:10.839172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c91411d6-b777-431d-80c7-78d781cb8139 req-4fccb1a0-dccd-4bc7-b1c2-e176a1cc391c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9feeb90-af89-4905-8830-d88a13334f0a", "name": "network-vif-deleted", "tag": "04fc5efc-f56d-4bc0-99a9-406bd591462b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:10.849661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c91411d6-b777-431d-80c7-78d781cb8139 req-4fccb1a0-dccd-4bc7-b1c2-e176a1cc391c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:10.850094 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c91411d6-b777-431d-80c7-78d781cb8139 req-4fccb1a0-dccd-4bc7-b1c2-e176a1cc391c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:10.863819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-c91411d6-b777-431d-80c7-78d781cb8139 req-4fccb1a0-dccd-4bc7-b1c2-e176a1cc391c service nova] Creating event network-vif-deleted:04fc5efc-f56d-4bc0-99a9-406bd591462b for instance d9feeb90-af89-4905-8830-d88a13334f0a on hv-cinder-79987 Jul 29 14:43:10.869277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c91411d6-b777-431d-80c7-78d781cb8139 req-4fccb1a0-dccd-4bc7-b1c2-e176a1cc391c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034453 Jul 29 14:43:10.869880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 416/821] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:11.366999 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:11.367576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:11.373967 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:11.374429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:11.375208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:11.375652 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:11.406284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:11.406737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:11.407213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'fault' on Instance uuid d9feeb90-af89-4905-8830-d88a13334f0a {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:43:11.451199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:11.458621 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-eb5ad329-cda3-474b-9a37-34b29145d533 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 200 len: 1335 microversion: 2.1 time: 0.096296 Jul 29 14:43:11.459192 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 406/822] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:11 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:12.481153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:12.481851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: d9feeb90-af89-4905-8830-d88a13334f0a] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:12.483807 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=44 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:12.488712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:12.489280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:12.490050 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:12.490491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:12.503997 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] HTTP exception thrown: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Request method failure captured: Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a HTTP/1.1 Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BE_a6vp_K8n1-US6WzucaZhFMyenbjTPUTnVeyOSxu0FM6xOYjY0UB936Vly2_5OLEouw-KH2CvHYYf4xrIhLlbVPEdTXfzXd9jGJ3V5sZ3BgahC6p8sX-WkwP_t4v9-Z2eD71KczBhgeGnaDpRwCFHhdvZZm0DSsNYnPYVSixxps Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:43:12.505640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82cd919860e249acb9dea7620506725b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82cd919860e249acb9dea7620506725b"}]}] Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f4ae3fb6a7954a24b88df4f35f55020c Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. Jul 29 14:43:12.508024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': 'd9feeb90-af89-4905-8830-d88a13334f0a'} Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:12.508967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. Jul 29 14:43:12.510234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:12.511408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Returning 404 to user: Instance d9feeb90-af89-4905-8830-d88a13334f0a could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:12.511408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-65d309bf-ac01-441b-8b72-add59732c68d tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a" status: 404 len: 111 microversion: 2.1 time: 0.031171 Jul 29 14:43:12.511408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 417/823] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:12 2022] GET /compute/v2.1/servers/d9feeb90-af89-4905-8830-d88a13334f0a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:43:12.516199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-022d696a-1eaa-41e7-8d9e-418a77b96330 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '.version_select at 0x7f68100a6310>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:12.579588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-022d696a-1eaa-41e7-8d9e-418a77b96330 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074115082" status: 202 len: 0 microversion: 2.1 time: 0.067110 Jul 29 14:43:12.580148 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 407/824] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 14:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074115082 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:15.855333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:15.855817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:15.862637 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:15.863088 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:15.863852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:15.864294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:15.889759 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:16.255591 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2cfb6526-de32-4c5b-b2ba-a4b7aa951b1c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 204 len: 0 microversion: 2.1 time: 0.404768 Jul 29 14:43:16.256162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 418/825] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:15 2022] DELETE /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:16.265570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:16.272085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:16.272085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:16.274308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:16.274759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:16.275531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:16.275969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:16.402425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:16.409903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-273f39f3-7455-4f82-b99c-97da500ef840 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1509 microversion: 2.1 time: 0.148887 Jul 29 14:43:16.410466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 408/826] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:16 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:17.431503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:17.432118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:17.438525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:17.438979 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:17.439758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:17.440198 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:17.633485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:17.640823 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-986245c4-2474-4556-a25b-5c625675d98c tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1509 microversion: 2.1 time: 0.213691 Jul 29 14:43:17.641423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 419/827] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:17 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:17.899086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-b083beee-2275-46be-84aa-b6a68db12865 req-8f5ede3c-840c-425b-87e5-0887b2ac2aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc46760-6ced-4861-8ee4-00e8d662c0ab", "name": "network-vif-deleted", "tag": "fd703da7-6ac9-4944-b5ef-7aa82be533b6"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:17.909861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-b083beee-2275-46be-84aa-b6a68db12865 req-8f5ede3c-840c-425b-87e5-0887b2ac2aa0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:17.910303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-b083beee-2275-46be-84aa-b6a68db12865 req-8f5ede3c-840c-425b-87e5-0887b2ac2aa0 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:17.923428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-b083beee-2275-46be-84aa-b6a68db12865 req-8f5ede3c-840c-425b-87e5-0887b2ac2aa0 service nova] Creating event network-vif-deleted:fd703da7-6ac9-4944-b5ef-7aa82be533b6 for instance edc46760-6ced-4861-8ee4-00e8d662c0ab on hv-cinder-79987 Jul 29 14:43:17.928587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-b083beee-2275-46be-84aa-b6a68db12865 req-8f5ede3c-840c-425b-87e5-0887b2ac2aa0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Jul 29 14:43:17.929409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 409/828] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:18.662809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:18.663420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:18.669874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:18.670384 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:18.672609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:18.672609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:18.702790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:18.703233 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:18.703675 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lazy-loading 'fault' on Instance uuid edc46760-6ced-4861-8ee4-00e8d662c0ab {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:43:18.744883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:18.752093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f23ab037-3ac0-4d80-8287-8a21048bde53 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 200 len: 1312 microversion: 2.1 time: 0.093847 Jul 29 14:43:18.752648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 420/829] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:18 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:19.774404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:19.775104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: edc46760-6ced-4861-8ee4-00e8d662c0ab] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:19.782369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:19.782822 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:19.783657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:19.784102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:19.797953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] HTTP exception thrown: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Request method failure captured: Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab HTTP/1.1 Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BE_a6vp_K8n1-US6WzucaZhFMyenbjTPUTnVeyOSxu0FM6xOYjY0UB936Vly2_5OLEouw-KH2CvHYYf4xrIhLlbVPEdTXfzXd9jGJ3V5sZ3BgahC6p8sX-WkwP_t4v9-Z2eD71KczBhgeGnaDpRwCFHhdvZZm0DSsNYnPYVSixxps Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:43:19.799934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82cd919860e249acb9dea7620506725b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82cd919860e249acb9dea7620506725b"}]}] Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f4ae3fb6a7954a24b88df4f35f55020c Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. Jul 29 14:43:19.801443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'edc46760-6ced-4861-8ee4-00e8d662c0ab'} Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:19.802321 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. Jul 29 14:43:19.803596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:19.805395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Returning 404 to user: Instance edc46760-6ced-4861-8ee4-00e8d662c0ab could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:19.805395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2593f39f-1dc5-4bcb-a42e-302ff608f997 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab" status: 404 len: 111 microversion: 2.1 time: 0.031608 Jul 29 14:43:19.805395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 410/830] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:19 2022] GET /compute/v2.1/servers/edc46760-6ced-4861-8ee4-00e8d662c0ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:43:19.810160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:19.810658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:19.817337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:19.817791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:19.818582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:19.819022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:19.844403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:20.110254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cf8a26c0-b76a-4996-af01-b2d041a9a107 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "DELETE /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 204 len: 0 microversion: 2.1 time: 0.303632 Jul 29 14:43:20.110839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 421/831] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:19 2022] DELETE /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:20.119409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:20.120043 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:20.126176 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:20.126619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:20.127380 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:20.127821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:20.266885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:20.274331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4acc4bfa-c34c-49ab-aaab-f6ad86d1c5ac tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.159330 Jul 29 14:43:20.274880 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 411/832] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:20 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:21.296212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:21.296964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:21.303821 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:21.304275 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:21.305076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:21.305521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:21.438360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:21.445802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-25a66c2f-585c-4c53-87b3-5c36ae3262a5 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.153974 Jul 29 14:43:21.447002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 422/833] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:21 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:22.468286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:22.468837 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:22.475303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:22.480010 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:22.480010 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:22.480010 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:22.604182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:22.611599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4ed0af2b-0eea-4ea4-b2f8-5313f47f24f0 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1520 microversion: 2.1 time: 0.147154 Jul 29 14:43:22.612184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 412/834] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:22 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:23.379495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-d0ac6c33-50ba-4768-93ca-a0d66ca9b38e req-7f541261-ac70-46bd-ab46-8efb15a078e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "540afb78-5835-4fc1-9779-59c54f993946", "name": "network-vif-deleted", "tag": "a72200fd-5afd-4bce-a98e-052d04bbd88e"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:23.390446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d0ac6c33-50ba-4768-93ca-a0d66ca9b38e req-7f541261-ac70-46bd-ab46-8efb15a078e9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:23.390900 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-d0ac6c33-50ba-4768-93ca-a0d66ca9b38e req-7f541261-ac70-46bd-ab46-8efb15a078e9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:23.401663 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-d0ac6c33-50ba-4768-93ca-a0d66ca9b38e req-7f541261-ac70-46bd-ab46-8efb15a078e9 service nova] Creating event network-vif-deleted:a72200fd-5afd-4bce-a98e-052d04bbd88e for instance 540afb78-5835-4fc1-9779-59c54f993946 on hv-cinder-79987 Jul 29 14:43:23.407551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-d0ac6c33-50ba-4768-93ca-a0d66ca9b38e req-7f541261-ac70-46bd-ab46-8efb15a078e9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030636 Jul 29 14:43:23.407551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 423/835] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:43:23.632949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:23.633522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:23.640921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:23.641401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:23.642166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:23.642601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:23.706190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ae3fb6a7954a24b88df4f35f55020c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82cd919860e249acb9dea7620506725b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:23.714162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a7c66484-63c9-43ba-a0d4-37fa66b8c8d4 tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 200 len: 1305 microversion: 2.1 time: 0.085038 Jul 29 14:43:23.715016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 413/836] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:23 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 1305 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:24.735931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:24.736649 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] [instance: 540afb78-5835-4fc1-9779-59c54f993946] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:24.743026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:24.744611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:24.745481 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:24.745922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:24.759021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] HTTP exception thrown: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Request method failure captured: Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 HTTP/1.1 Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BE_a6vp_K8n1-US6WzucaZhFMyenbjTPUTnVeyOSxu0FM6xOYjY0UB936Vly2_5OLEouw-KH2CvHYYf4xrIhLlbVPEdTXfzXd9jGJ3V5sZ3BgahC6p8sX-WkwP_t4v9-Z2eD71KczBhgeGnaDpRwCFHhdvZZm0DSsNYnPYVSixxps Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:43:24.760667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_82cd919860e249acb9dea7620506725b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/82cd919860e249acb9dea7620506725b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/82cd919860e249acb9dea7620506725b"}]}] Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 82cd919860e249acb9dea7620506725b Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-149155097 Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f4ae3fb6a7954a24b88df4f35f55020c Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-ServerRescueNegativeTestJSON-149155097-project Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. Jul 29 14:43:24.762320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '540afb78-5835-4fc1-9779-59c54f993946'} Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:24.763351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. Jul 29 14:43:24.764851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:24.766327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] Returning 404 to user: Instance 540afb78-5835-4fc1-9779-59c54f993946 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:24.766327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fbf4e542-2eab-4b0f-8f6b-b2a99f57824a tempest-ServerRescueNegativeTestJSON-149155097 tempest-ServerRescueNegativeTestJSON-149155097-project] 10.222.0.49 "GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946" status: 404 len: 111 microversion: 2.1 time: 0.030839 Jul 29 14:43:24.766327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 424/837] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:24 2022] GET /compute/v2.1/servers/540afb78-5835-4fc1-9779-59c54f993946 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:43:25.666928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-186770334"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:25.667499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:25.674215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:25.674663 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:25.675432 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:25.675874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:25.843530 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.network.security_group_api [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Removing security group a777fe6a-cfb9-45a8-995a-2eec38da446b from port afab12c7-2e78-478f-a6fe-2683d302fb65 Jul 29 14:43:26.754926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a4761e03-bcaf-48f3-b1c9-be8de299e098 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action" status: 202 len: 0 microversion: 2.1 time: 1.092160 Jul 29 14:43:26.759893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 414/838] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:43:25 2022] POST /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/action => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:26.764561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-f1c82f48-3dbf-4eeb-b98f-ec82c729f2db req-944dbda1-729a-4986-9cad-b199d595c25f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:26.776986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f1c82f48-3dbf-4eeb-b98f-ec82c729f2db req-944dbda1-729a-4986-9cad-b199d595c25f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:26.777455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-f1c82f48-3dbf-4eeb-b98f-ec82c729f2db req-944dbda1-729a-4986-9cad-b199d595c25f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:26.791925 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-f1c82f48-3dbf-4eeb-b98f-ec82c729f2db req-944dbda1-729a-4986-9cad-b199d595c25f service nova] Creating event network-changed:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:43:26.797432 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-f1c82f48-3dbf-4eeb-b98f-ec82c729f2db req-944dbda1-729a-4986-9cad-b199d595c25f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038178 Jul 29 14:43:26.798205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 425/839] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:28.615692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:28.616830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:28.624241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:28.625115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:28.626942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:28.627771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:28.723437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lazy-loading 'services' on Instance uuid 9e40e139-fef6-4a86-b55b-deda059ea51b {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:43:28.817246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-b843d7f0-560f-4ec8-b2b3-df774c314043 req-f62e9f93-2a97-427e-ab69-0b8ce44bc714 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:28.829988 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b843d7f0-560f-4ec8-b2b3-df774c314043 req-f62e9f93-2a97-427e-ab69-0b8ce44bc714 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:28.830687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b843d7f0-560f-4ec8-b2b3-df774c314043 req-f62e9f93-2a97-427e-ab69-0b8ce44bc714 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:28.848340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-b843d7f0-560f-4ec8-b2b3-df774c314043 req-f62e9f93-2a97-427e-ab69-0b8ce44bc714 service nova] Creating event network-changed:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:43:28.853308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-b843d7f0-560f-4ec8-b2b3-df774c314043 req-f62e9f93-2a97-427e-ab69-0b8ce44bc714 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041888 Jul 29 14:43:28.853902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 426/840] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:29.016023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-43af6c30-4bba-41ab-9015-bb5abe7ecc51 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments/04236799-ae50-4e1c-b79d-7aa26e9bccda" status: 202 len: 0 microversion: 2.1 time: 0.404522 Jul 29 14:43:29.026790 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:29.030416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:29.034466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 415/841] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:43:28 2022] DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments/04236799-ae50-4e1c-b79d-7aa26e9bccda => generated 0 bytes in 410 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:29.044871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:29.048257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:29.050310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:29.051463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:29.110753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1c1388cd-1caf-4b2d-a87c-aa76c4a07409 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088871 Jul 29 14:43:29.115376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 427/842] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:29 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:43:30.123263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:30.125701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:30.132195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:30.132637 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:30.133450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:30.134550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:30.165081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1b913407-db18-4011-b77e-d0013059fe1c tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045926 Jul 29 14:43:30.165671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 416/843] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:30 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:31.177370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:31.179455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:31.186268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.186728 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.187503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.187954 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.217909 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ffbd6e30-8f5c-438d-843b-48ebb03eb34d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044947 Jul 29 14:43:31.222446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 428/844] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:31 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:43:31.229453 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:31.229978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:31.236263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.236708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.237508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.238213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.258086 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:31.273429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:31.273873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:31.283229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.283229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.283229 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.283589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.311005 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:31.326011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:31.326192 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] HTTP exception thrown: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b is not attached to volume 04236799-ae50-4e1c-b79d-7aa26e9bccda Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Request method failure captured: Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments/04236799-ae50-4e1c-b79d-7aa26e9bccda HTTP/1.1 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_EVyq49cZgypytZN22j6LrlXDecQodvv2OoBiYSGlcHCHZmLpNmP0X2PFWZtFqlstNuZPw_xxfH-Q8uu397Yh8EXc79q-MjnUtTCOCwpddXCrYNQcujob1gOZnHun1Xv_dk1SjYfseihqRYAaNlUlcBCAPUAcKpGRAm0cRabpu2_r4 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: c5c24df7687b4e7093911f73e21b522a Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:43:31.329383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5c24df7687b4e7093911f73e21b522a"}]}] Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: c5c24df7687b4e7093911f73e21b522a Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-TestMinimumBasicScenario-1643308210-project Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 3b3047e3ab2046c580e987a6518a4612 Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-TestMinimumBasicScenario-1643308210-project Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:43:31.330703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b is not attached to volume 04236799-ae50-4e1c-b79d-7aa26e9bccda Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'server_id': '9e40e139-fef6-4a86-b55b-deda059ea51b', 'id': '04236799-ae50-4e1c-b79d-7aa26e9bccda'} Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04236799-ae50-4e1c-b79d-7aa26e9bccda. Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:31.331509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b is not attached to volume 04236799-ae50-4e1c-b79d-7aa26e9bccda Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b is not attached to volume 04236799-ae50-4e1c-b79d-7aa26e9bccda Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:31.336311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Returning 404 to user: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b is not attached to volume 04236799-ae50-4e1c-b79d-7aa26e9bccda {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:31.339366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c1acc4c4-9ed5-47ff-9e10-b03435b92d6b tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments/04236799-ae50-4e1c-b79d-7aa26e9bccda" status: 404 len: 154 microversion: 2.1 time: 0.106159 Jul 29 14:43:31.339366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 417/845] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:43:31 2022] DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b/os-volume_attachments/04236799-ae50-4e1c-b79d-7aa26e9bccda => generated 154 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:43:31.576360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2508145d-29eb-4897-9c93-4c5f4a1f9582 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 204 len: 0 microversion: 2.1 time: 0.307058 Jul 29 14:43:31.580732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 429/846] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:31 2022] DELETE /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:31.588633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:31.589755 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:31.597327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.597857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.598736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:31.601720 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:31.739476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:31.748620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0f487842-9204-4b24-a97c-1db70b21faaa tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1577 microversion: 2.1 time: 0.166471 Jul 29 14:43:31.752923 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 418/847] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:31 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:32.625239 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:32.625855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:32.632273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.632720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:32.633603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.634306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:32.658718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:32.771174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:32.771789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:32.779699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.780052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:32.780832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.781295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:32.919344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:32.927311 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3fb5843c-3211-4cee-a6d0-e17d7dd654cd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1577 microversion: 2.1 time: 0.160028 Jul 29 14:43:32.927871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 419/848] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:32 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:43:32.929847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-12d790a6-bcd3-4d96-bcea-0023ebdaf352 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 204 len: 0 microversion: 2.1 time: 0.308790 Jul 29 14:43:32.930544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 430/849] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:32 2022] DELETE /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:32.938678 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:32.941077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:32.945244 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.945696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:32.947063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:32.947497 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:33.078614 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:33.086139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ec682a63-fd20-4083-aa8a-ea65cbb54d68 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1554 microversion: 2.1 time: 0.151140 Jul 29 14:43:33.087367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 420/850] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:32 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:33.949358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:33.950058 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:33.956536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:33.957009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:33.957795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:33.958236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:34.087646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:34.095235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-38f20525-5ed0-42d5-86c0-f89663fdd4fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1577 microversion: 2.1 time: 0.150765 Jul 29 14:43:34.095826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 431/851] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:33 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:34.108478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:34.109156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:34.115841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:34.116289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:34.117110 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:34.117552 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:34.252825 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:34.261194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c6c9d043-9362-4739-a0ce-ad001ca09028 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1554 microversion: 2.1 time: 0.156780 Jul 29 14:43:34.261765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 421/852] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:34 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:35.116573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:35.117134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:35.124767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:35.125254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:35.126049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:35.126483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:35.260696 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:35.268592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75df6d87-ff4f-42d7-a464-7df0191e1b99 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1577 microversion: 2.1 time: 0.156026 Jul 29 14:43:35.269180 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 432/853] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:35 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:35.281402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:35.282012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:35.288381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:35.288823 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:35.289633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:35.290673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:35.419105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:35.427438 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7d57447b-47e3-417d-94d6-d311cd601455 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1554 microversion: 2.1 time: 0.149786 Jul 29 14:43:35.428262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 422/854] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:35 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:36.289971 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:36.290621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:36.297455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:36.297913 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:36.298969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:36.299416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:36.448343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:36.449116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:36.460249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:36.460249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:36.460249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:36.460249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:36.588631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:36.598738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-44083043-0cb7-41ea-81e6-56951e1d962d tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1554 microversion: 2.1 time: 0.154440 Jul 29 14:43:36.603412 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:36.609502 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 423/855] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:36 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:43:36.627144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e8941f33-211e-4fe1-9b05-f6e83cc0da53 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1577 microversion: 2.1 time: 0.339029 Jul 29 14:43:36.627144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 433/856] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:36 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1577 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:36.699489 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-7befa919-1425-4927-8e1e-5bbe4897b8c3 req-d9142fe1-11ca-4576-9987-3c627e2fa6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e40e139-fef6-4a86-b55b-deda059ea51b", "name": "network-vif-deleted", "tag": "afab12c7-2e78-478f-a6fe-2683d302fb65"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:36.708815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7befa919-1425-4927-8e1e-5bbe4897b8c3 req-d9142fe1-11ca-4576-9987-3c627e2fa6da service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:36.712983 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7befa919-1425-4927-8e1e-5bbe4897b8c3 req-d9142fe1-11ca-4576-9987-3c627e2fa6da service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:36.721400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-7befa919-1425-4927-8e1e-5bbe4897b8c3 req-d9142fe1-11ca-4576-9987-3c627e2fa6da service nova] Creating event network-vif-deleted:afab12c7-2e78-478f-a6fe-2683d302fb65 for instance 9e40e139-fef6-4a86-b55b-deda059ea51b on hv-cinder-79987 Jul 29 14:43:36.726254 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-7befa919-1425-4927-8e1e-5bbe4897b8c3 req-d9142fe1-11ca-4576-9987-3c627e2fa6da service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030952 Jul 29 14:43:36.726831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 424/857] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:43:37.622630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:37.623249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:37.630261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:37.630726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:37.631521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:37.631958 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:37.649317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:37.651022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:37.659422 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:37.659876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:37.660801 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:37.661281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:37.668127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:37.668868 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:37.669769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lazy-loading 'fault' on Instance uuid 9e40e139-fef6-4a86-b55b-deda059ea51b {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:43:37.718087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b3047e3ab2046c580e987a6518a4612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5c24df7687b4e7093911f73e21b522a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:37.728205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5746a0a6-619d-483f-b227-76f2a7dd0a55 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 200 len: 1348 microversion: 2.1 time: 0.109439 Jul 29 14:43:37.734553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 434/858] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:37 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:37.746507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:37.756399 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ef9d213f-6bde-4808-b24d-d6e6e8bab220 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 200 len: 1226 microversion: 2.1 time: 0.112321 Jul 29 14:43:37.757751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 425/859] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:37 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 1226 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:38.741221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-4cd2e0cb-c604-4a77-a757-ffe124171c29 req-837128a2-f5b5-4d28-bd91-c720848fd8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6275089c-3a8d-4785-9bea-bfa300e57580", "name": "network-vif-deleted", "tag": "b09d2a6b-fd57-4a55-a66e-36abbc1e72c7"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:38.749554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:38.750263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] [instance: 9e40e139-fef6-4a86-b55b-deda059ea51b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:38.750989 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4cd2e0cb-c604-4a77-a757-ffe124171c29 req-837128a2-f5b5-4d28-bd91-c720848fd8f6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:38.751441 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4cd2e0cb-c604-4a77-a757-ffe124171c29 req-837128a2-f5b5-4d28-bd91-c720848fd8f6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:38.756782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:38.757267 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:38.758051 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:38.759073 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:38.762907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-4cd2e0cb-c604-4a77-a757-ffe124171c29 req-837128a2-f5b5-4d28-bd91-c720848fd8f6 service nova] Creating event network-vif-deleted:b09d2a6b-fd57-4a55-a66e-36abbc1e72c7 for instance 6275089c-3a8d-4785-9bea-bfa300e57580 on hv-cinder-79987 Jul 29 14:43:38.767731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-4cd2e0cb-c604-4a77-a757-ffe124171c29 req-837128a2-f5b5-4d28-bd91-c720848fd8f6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030304 Jul 29 14:43:38.768321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 435/860] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:38.774683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] HTTP exception thrown: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Request method failure captured: Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b HTTP/1.1 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_EVyq49cZgypytZN22j6LrlXDecQodvv2OoBiYSGlcHCHZmLpNmP0X2PFWZtFqlstNuZPw_xxfH-Q8uu397Yh8EXc79q-MjnUtTCOCwpddXCrYNQcujob1gOZnHun1Xv_dk1SjYfseihqRYAaNlUlcBCAPUAcKpGRAm0cRabpu2_r4 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: c5c24df7687b4e7093911f73e21b522a Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:43:38.776340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/c5c24df7687b4e7093911f73e21b522a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/c5c24df7687b4e7093911f73e21b522a"}]}] Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: c5c24df7687b4e7093911f73e21b522a Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1643308210 Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-TestMinimumBasicScenario-1643308210-project Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 3b3047e3ab2046c580e987a6518a4612 Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-TestMinimumBasicScenario-1643308210-project Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. Jul 29 14:43:38.777883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '9e40e139-fef6-4a86-b55b-deda059ea51b'} Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:38.778740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. Jul 29 14:43:38.780065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.781142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Returning 404 to user: Instance 9e40e139-fef6-4a86-b55b-deda059ea51b could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:38.781142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-63c29a6d-1b98-4d3e-8a9e-9ec668076685 tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b" status: 404 len: 111 microversion: 2.1 time: 0.032091 Jul 29 14:43:38.781142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 426/861] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:38 2022] GET /compute/v2.1/servers/9e40e139-fef6-4a86-b55b-deda059ea51b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:43:38.786206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-45721125-b20c-4d24-8b7d-498726e4423e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] Calling method '.version_select at 0x7f681013eee0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:38.786871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:38.787577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:38.794860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:38.795307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:38.796149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:38.796617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:38.811108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] HTTP exception thrown: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Request method failure captured: Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 HTTP/1.1 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_Eu94sf8QgTIB90reYSsID2p_Kgsu82Q474Q2Dk9Dp-N_w0UyfrylITqk7vuLBVYs1QNSNwuMsvAcxYx0S3uaOla6dSyZU9ULMFjYvlWUBSnki-3x5JcLL8US75czk32o_RqQ2gqMalLO8IsCrkgpYX_Q0FieF9beZCBo5PcIkIg3E Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:43:38.812738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10f1fba5db2b4402b2fe8d12d099e331"}]}] Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f9360a76354e4ae99668fe8debe4e7fb Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:43:38.814343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '6275089c-3a8d-4785-9bea-bfa300e57580'} Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:38.815144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:43:38.816397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:43:38.817568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Returning 404 to user: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:38.817568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b3ac76ad-24e9-4264-a303-27bede791272 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 404 len: 111 microversion: 2.1 time: 0.031426 Jul 29 14:43:38.817568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 436/862] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:38 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:43:38.867696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-45721125-b20c-4d24-8b7d-498726e4423e tempest-TestMinimumBasicScenario-1643308210 tempest-TestMinimumBasicScenario-1643308210-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2065034953" status: 202 len: 0 microversion: 2.1 time: 0.084951 Jul 29 14:43:38.868892 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 427/863] 10.222.0.49 () {58 vars in 1272 bytes} [Fri Jul 29 14:43:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2065034953 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:38.916249 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-324781349", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345170100", "security_groups": [{"name": "tempest-secgroup-smoke-67867029"}], "block_device_mapping_v2": [{"uuid": "0af0ffcb-c99d-44fa-9886-ef17a341bdb3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16aee007-d69b-4d84-b034-615cf90e91d9"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:39.033794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] validate_networks() for [('16aee007-d69b-4d84-b034-615cf90e91d9', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:43:39.511460 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:43:39.511887 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:43:39.512391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:43:39.512797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:43:39.513248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:43:39.522245 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:39.522697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:39.523498 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:39.523960 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:39.540916 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:43:39.544919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for user f9360a76354e4ae99668fe8debe4e7fb and project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:43:39.601727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:43:39.604341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0af0ffcb-c99d-44fa-9886-ef17a341bdb3',volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:43:40.051510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b4769b10-dbdd-43c4-bedf-09a2d15666a3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.139907 Jul 29 14:43:40.052225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 437/864] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:43:38 2022] POST /compute/v2.1/servers => generated 404 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:43:40.063700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6f04af3c-28e2-470c-9356-b4dcd4da07fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:40.064495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6f04af3c-28e2-470c-9356-b4dcd4da07fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:40.125689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6f04af3c-28e2-470c-9356-b4dcd4da07fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:40.132434 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6f04af3c-28e2-470c-9356-b4dcd4da07fb tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1094 microversion: 2.1 time: 0.072653 Jul 29 14:43:40.134184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 428/865] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:40 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:41.155146 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:41.155792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:41.163071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:41.163587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:41.164447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:41.165130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:41.226397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:41.234154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f3b594c-57ae-4d07-917b-13ea9a2295d7 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1144 microversion: 2.1 time: 0.083507 Jul 29 14:43:41.234707 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 438/866] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:41 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:42.254664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:42.255280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:42.263429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:42.264435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:42.265459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:42.267371 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:42.370725 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:42.378537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-86ea9aea-b2c1-4e29-911c-2e228ec2f77e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1144 microversion: 2.1 time: 0.127746 Jul 29 14:43:42.379106 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 429/867] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:42 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1144 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:43.195200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:43.198176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:43.204921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.205414 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.206197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.206641 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.242370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fd8d64f5-2443-48e8-b08f-8fee44f78473 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051101 Jul 29 14:43:43.243308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 439/868] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:43:43 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:43:43.316281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:43.316778 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:43.324158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.324612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.325423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.325863 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.352499 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:43:43.399708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:43.400571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:43.406915 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.407293 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.408073 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.408509 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.568825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:43.577836 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f0bbe7a4-fc63-4f74-bdf5-4264dcb21e40 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1200 microversion: 2.1 time: 0.182604 Jul 29 14:43:43.593382 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 440/869] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:43 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1200 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:43:43.761693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ce2d6dfa-b3bc-4a9d-aa59-e4f2290fcd15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 204 len: 0 microversion: 2.1 time: 0.447751 Jul 29 14:43:43.763261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 430/870] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:43:43 2022] DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:43:43.775316 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:43.776194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:43.788765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.789257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:43.790457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:43.790905 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:44.003172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:44.010861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-57e813d7-8dc3-46ae-b7c5-ba6ba8a39ee4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1674 microversion: 2.1 time: 0.239828 Jul 29 14:43:44.011424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 441/871] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:43 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1674 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:44.600303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:44.601103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:44.608083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:44.608544 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:44.609577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:44.616301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:44.709764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:44.719937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-43bbcb49-0b8a-4420-a3ed-ecfbbfc17407 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1210 microversion: 2.1 time: 0.123285 Jul 29 14:43:44.725539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 431/872] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:44 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1210 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:45.033375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:45.040096 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:45.041064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:45.041525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:45.042318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:45.042761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:45.643469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:45.651642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-82684cf6-8911-4182-8b62-d6e93041f95f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1674 microversion: 2.1 time: 0.622208 Jul 29 14:43:45.652232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 442/873] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:45 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1674 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:45.755205 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:45.755858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:45.767266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:45.767727 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:45.768715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:45.769204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:45.842651 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:45.850838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-eb311dee-465b-436e-9df9-77e022e1eab4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1210 microversion: 2.1 time: 0.113681 Jul 29 14:43:45.852542 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 432/874] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:45 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1210 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:46.673735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:46.676720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:46.681449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:46.686837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:46.690186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:46.690186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:46.690186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:46.872635 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:46.875204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:46.888661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:46.889504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:46.891387 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:46.892247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:47.081875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:47.092383 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-168bebd5-7f04-4ead-b77b-41a8efd57979 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1276 microversion: 2.1 time: 0.223577 Jul 29 14:43:47.093054 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 433/875] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:46 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1276 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:43:47.179117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:47.187449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-477c3cd7-4ea6-479c-95e3-f5e8f3602388 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1674 microversion: 2.1 time: 0.517996 Jul 29 14:43:47.189179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 443/876] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:46 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1674 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:48.096642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-f53aadb2-26ba-436b-864f-03feb0f04734 req-fda7788d-2c30-4c45-a65a-9edde4572b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd0a632-5ab1-4f92-8793-e25143d73dac", "name": "network-vif-deleted", "tag": "a7f344b9-d58e-4eb7-b77e-49116544a3bb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:48.128755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:48.132283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:48.155961 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f53aadb2-26ba-436b-864f-03feb0f04734 req-fda7788d-2c30-4c45-a65a-9edde4572b76 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:48.161662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f53aadb2-26ba-436b-864f-03feb0f04734 req-fda7788d-2c30-4c45-a65a-9edde4572b76 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:48.166535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:48.172693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:48.184568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:48.188208 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:48.220171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-f53aadb2-26ba-436b-864f-03feb0f04734 req-fda7788d-2c30-4c45-a65a-9edde4572b76 service nova] Creating event network-vif-deleted:a7f344b9-d58e-4eb7-b77e-49116544a3bb for instance 3bd0a632-5ab1-4f92-8793-e25143d73dac on hv-cinder-79987 Jul 29 14:43:48.225473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-f53aadb2-26ba-436b-864f-03feb0f04734 req-fda7788d-2c30-4c45-a65a-9edde4572b76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136236 Jul 29 14:43:48.226237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 434/877] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:48.235677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:48.236558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:48.246426 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:48.247114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:48.248278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:48.248919 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:48.412166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:48.420768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c9006cca-dfe3-44b5-8903-fa479c157a2f tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 200 len: 1323 microversion: 2.1 time: 0.189517 Jul 29 14:43:48.430654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 435/878] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:48 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:48.631073 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:48.642027 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-03764aca-0cba-4691-9b21-87b6ec4780b1 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.526554 Jul 29 14:43:48.643567 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 444/879] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:48 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:49.453184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:49.453791 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:49.460442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:49.460887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:49.462328 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:49.462766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:49.476964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac HTTP/1.1 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:43:49.478648 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:43:49.480123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '3bd0a632-5ab1-4f92-8793-e25143d73dac'} Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:43:49.481109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:43:49.482526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:43:49.483818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:43:49.483818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5d950124-bb77-4f58-b590-fe2dd5ebf37a tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 404 len: 111 microversion: 2.1 time: 0.030774 Jul 29 14:43:49.483818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 436/880] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:49 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:43:49.492699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de44e201-a5ca-4080-a72a-435b0904b56e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '.version_select at 0x7f681012c820>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:49.531114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:49.551840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:49.594027 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de44e201-a5ca-4080-a72a-435b0904b56e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798779586" status: 202 len: 0 microversion: 2.1 time: 0.105021 Jul 29 14:43:49.594848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 445/881] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 14:43:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1798779586 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:43:49.665241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:49.666003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:49.673925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:49.674515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:49.675567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:49.676234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:49.682195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:49.887469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:49.895245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c0ce9db3-eb0e-418c-9f50-09df164a6071 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.234851 Jul 29 14:43:49.896257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 437/882] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:49 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:50.260867 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-9295de2f-6fba-412c-8ca7-ac1061c00824 req-9e7f306b-6fcf-4d15-8563-261a61e17a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd5b621-deb0-400f-8a0c-53cf309b634c", "tag": "fca761d5-971a-4e4c-bae3-800888a36beb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:50.278895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9295de2f-6fba-412c-8ca7-ac1061c00824 req-9e7f306b-6fcf-4d15-8563-261a61e17a62 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:50.279501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9295de2f-6fba-412c-8ca7-ac1061c00824 req-9e7f306b-6fcf-4d15-8563-261a61e17a62 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:50.283954 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:50.296085 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-9295de2f-6fba-412c-8ca7-ac1061c00824 req-9e7f306b-6fcf-4d15-8563-261a61e17a62 service nova] Creating event network-changed:fca761d5-971a-4e4c-bae3-800888a36beb for instance ddd5b621-deb0-400f-8a0c-53cf309b634c on hv-cinder-79987 Jul 29 14:43:50.304424 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-9295de2f-6fba-412c-8ca7-ac1061c00824 req-9e7f306b-6fcf-4d15-8563-261a61e17a62 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046777 Jul 29 14:43:50.307155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 446/883] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:43:50.737853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-928dadf8-ace8-48a1-85a7-79c37b2968b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: .version_select at 0x7f6810183dc0>, body: {"keypair": {"name": "tempest-keypair-1015561879", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVqGbCBcqqXYdEAvm1gUTXx+9MSIXR7398Wjgm3dg+46mWJ79yOIwnTZZwZYTl1OtXS6nRCk1GmtXfrDRiNxUzh7CrmbxA5+8s7he54Abi1G+kjCpasf8XxXPwV137nTQ=="}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:50.743558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:50.744672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:43:50.755575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-928dadf8-ace8-48a1-85a7-79c37b2968b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:43:50.760235 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-928dadf8-ace8-48a1-85a7-79c37b2968b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for user f3a38dc21bc34164aea48065da64823f and project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'key_pairs'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:43:50.855396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-928dadf8-ace8-48a1-85a7-79c37b2968b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122446 Jul 29 14:43:50.856474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 438/884] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:43:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:43:50.918813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:50.919830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:50.927207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:50.927896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:50.928666 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:50.929195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:51.213636 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:51.243968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8374797-14e4-426c-b982-128c8b9851bf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.330398 Jul 29 14:43:51.247819 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 447/885] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:50 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:52.272685 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:52.272685 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:52.278948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:52.279378 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:52.280342 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:52.280789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:52.427669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:52.439319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f669c06c-4243-41e1-845a-8522b9e533f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.175402 Jul 29 14:43:52.440656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 439/886] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:52 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:53.460871 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:53.462085 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:53.490135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:53.490135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:53.490135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:53.490135 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:53.548605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-179887830", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8907ae4f-3672-490c-8621-c3c212e0a603"}], "security_groups": [{"name": "tempest-securitygroup--1610918543"}], "key_name": "tempest-keypair-1015561879", "user_data": "}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:53.670089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:53.671909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] validate_networks() for [('8907ae4f-3672-490c-8621-c3c212e0a603', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:43:53.681844 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-459c897d-8aa4-48bb-8aeb-50d92f7ffda0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.224704 Jul 29 14:43:53.682437 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 448/887] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:53 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:54.050240 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:43:54.050687 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:43:54.051178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:43:54.051582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:43:54.051995 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:43:54.061377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:54.061831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:54.062666 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:54.063108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:54.079753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:43:54.083719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Getting quotas for user f3a38dc21bc34164aea48065da64823f and project 44c869dc06224bf49f25fcf7aeb0e5a7. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:43:54.096069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:43:54.098409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:43:54.327826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4ece7444-47f7-4f0d-988c-0b1b0baab8e7 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.784215 Jul 29 14:43:54.328584 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 440/888] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:43:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:43:54.340324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e035fdbc-4d18-4cf9-b082-67ad067886f4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:54.341207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e035fdbc-4d18-4cf9-b082-67ad067886f4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:54.395336 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e035fdbc-4d18-4cf9-b082-67ad067886f4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:54.402367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e035fdbc-4d18-4cf9-b082-67ad067886f4 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1237 microversion: 2.1 time: 0.066813 Jul 29 14:43:54.402932 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 449/889] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:54 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:54.703175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:54.703790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:54.710976 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:54.712774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:54.713537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:54.713978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:54.847036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:54.854787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9694f451-56e1-478f-8dc9-aeaaa771856b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.155570 Jul 29 14:43:54.855371 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 441/890] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:54 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:55.424125 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:55.424635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:55.431721 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:55.432174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:55.432947 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:55.433415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:55.509082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:55.516855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-552e52cb-c499-4615-9ffe-7724ca21763c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1241 microversion: 2.1 time: 0.096935 Jul 29 14:43:55.517467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 450/891] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:55 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:55.876118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:55.876760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:55.884116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:55.884572 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:55.885384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:55.885812 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:56.021843 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:56.029741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-edb42ce4-61e7-4a61-8350-96f00bc626f9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.157502 Jul 29 14:43:56.030299 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 442/892] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:55 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:56.538391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:56.539042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:56.546399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:56.546853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:56.547630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:56.548069 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:56.613125 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:56.625267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f927a14f-0077-426b-af2f-05ac5278de09 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1233 microversion: 2.1 time: 0.086370 Jul 29 14:43:56.625267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 451/893] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:56 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:57.051137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:57.051975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:57.059485 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:57.059941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:57.060729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:57.061216 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:57.202872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:57.210590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-075ea5ca-4b0a-4249-8ea1-3898799c6dce tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.163655 Jul 29 14:43:57.211171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 443/894] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:57 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:57.641426 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:57.641993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:57.648357 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:57.648920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:57.649783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:57.650222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:57.733690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:57.741391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-827135e9-d239-45f8-8b50-79e41d8e26dd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1297 microversion: 2.1 time: 0.104046 Jul 29 14:43:57.741969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 452/895] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:57 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1297 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:58.230977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:58.231911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:58.239797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:58.240492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:58.241781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:58.242231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:58.433541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:58.441942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-71002b41-6490-4eed-bed6-af20ce008826 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.215286 Jul 29 14:43:58.442854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 444/896] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:58 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:43:58.763398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:58.764194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:58.771380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:58.771840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:58.773284 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:58.773990 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:59.045621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:59.052799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-13433fa6-4fb2-45bd-b8fa-5819ba37aab0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.293430 Jul 29 14:43:59.053480 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 453/897] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:58 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:43:59.464493 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:43:59.465129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:43:59.471655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:59.473951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:59.473951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:59.473951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:59.561782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-333b5fa8-4c7c-41d1-87b7-a3ad3fa5e38e req-8ef2fdef-32c1-4220-a4ed-64ce6f098a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c97655f-b4c4-4378-ada2-dac458762af0", "tag": "2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:43:59.571954 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-333b5fa8-4c7c-41d1-87b7-a3ad3fa5e38e req-8ef2fdef-32c1-4220-a4ed-64ce6f098a9f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:43:59.572609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-333b5fa8-4c7c-41d1-87b7-a3ad3fa5e38e req-8ef2fdef-32c1-4220-a4ed-64ce6f098a9f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:43:59.586144 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-333b5fa8-4c7c-41d1-87b7-a3ad3fa5e38e req-8ef2fdef-32c1-4220-a4ed-64ce6f098a9f service nova] Creating event network-changed:2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb for instance 3c97655f-b4c4-4378-ada2-dac458762af0 on hv-cinder-79987 Jul 29 14:43:59.591557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-333b5fa8-4c7c-41d1-87b7-a3ad3fa5e38e req-8ef2fdef-32c1-4220-a4ed-64ce6f098a9f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Jul 29 14:43:59.592518 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 454/898] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:43:59.653233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:43:59.664203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1ee4f8d3-dff5-4ec9-a4b3-a29423a02c79 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.204169 Jul 29 14:43:59.666072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 445/899] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:43:59 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:00.079598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:00.089120 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:00.089120 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:00.089120 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:00.089731 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:00.090193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:00.291374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:00.299353 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f7c1403e-3c0d-44fd-8f93-ec7f54343365 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.224437 Jul 29 14:44:00.299924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 455/900] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:00 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:00.689266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:00.689934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:00.697640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:00.698096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:00.699107 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:00.702765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:00.715775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-9f241e29-05f3-4760-8e7c-c43c7ebfd546 req-fa789e1a-544c-4fe8-ad5f-0a70b699ef6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd5b621-deb0-400f-8a0c-53cf309b634c", "name": "network-vif-plugged", "status": "completed", "tag": "fca761d5-971a-4e4c-bae3-800888a36beb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:00.725942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9f241e29-05f3-4760-8e7c-c43c7ebfd546 req-fa789e1a-544c-4fe8-ad5f-0a70b699ef6b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:00.726386 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-9f241e29-05f3-4760-8e7c-c43c7ebfd546 req-fa789e1a-544c-4fe8-ad5f-0a70b699ef6b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:00.738005 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-9f241e29-05f3-4760-8e7c-c43c7ebfd546 req-fa789e1a-544c-4fe8-ad5f-0a70b699ef6b service nova] Creating event network-vif-plugged:fca761d5-971a-4e4c-bae3-800888a36beb for instance ddd5b621-deb0-400f-8a0c-53cf309b634c on hv-cinder-79987 Jul 29 14:44:00.743687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-9f241e29-05f3-4760-8e7c-c43c7ebfd546 req-fa789e1a-544c-4fe8-ad5f-0a70b699ef6b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036662 Jul 29 14:44:00.744497 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 456/901] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:00.843089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:00.850734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-282da29c-ae03-45f1-a3f3-05d09261e31b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.165414 Jul 29 14:44:00.851286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 446/902] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:00 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:01.320173 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:01.321507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:01.327611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:01.328057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:01.328824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:01.329293 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:01.462011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:01.469683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1bd7a2c8-334c-4892-8a70-561d99dc35c6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.154176 Jul 29 14:44:01.470246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 457/903] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:01 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:01.872315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:01.872935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:01.879513 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:01.886522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:01.886522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:01.886522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:02.020903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:02.029080 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-23ed9a86-b98d-4361-91d9-477bebb511f8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.160567 Jul 29 14:44:02.029525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 447/904] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:01 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:02.490706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:02.491325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:02.498040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:02.498500 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:02.499282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:02.499724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:02.627343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:02.634783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ce6e4fb-c2ae-4fee-b83c-3aae7502ed6e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.147991 Jul 29 14:44:02.635341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 458/905] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:02 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:03.050487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:03.051101 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:03.057561 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:03.058008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:03.058767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:03.059202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:03.192754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:03.200459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-513015e7-7c5f-4839-b924-61ed5f9c2b92 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.154150 Jul 29 14:44:03.201040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 448/906] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:03 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:44:03.655876 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:03.656399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:03.662857 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:03.663337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:03.664114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:03.664698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:04.051313 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:04.058841 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f3469bde-71f6-4965-8030-881cded450a5 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.406871 Jul 29 14:44:04.059403 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 459/907] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:03 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:04.220465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:04.221093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:04.223392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:04.224138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=10 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:04.229074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:04.229524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:04.230289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:04.230723 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:04.586819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:04.594355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c4892222-2ebd-4aa0-af31-15d10730381d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.377730 Jul 29 14:44:04.594946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 449/908] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:04 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:05.079345 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:05.079957 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:05.081935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:05.088029 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:05.088448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:05.089259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:05.089698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:05.230459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:05.239049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a30efbc5-fb1f-4756-b2d1-f1ab4d831456 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.163382 Jul 29 14:44:05.253170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 460/909] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:05 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:05.614839 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:05.615534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:05.622795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:05.623340 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:05.624301 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:05.624958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:05.759934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:05.767597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a6121b72-a95c-496f-9abe-1d89dd8f7af9 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1264 microversion: 2.1 time: 0.156624 Jul 29 14:44:05.768157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 450/910] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:05 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:06.261017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:06.261621 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:06.268015 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:06.268466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:06.269265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:06.269703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:06.405099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:06.412634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b51d596f-1431-48f0-9b09-3de9edc1da15 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.156134 Jul 29 14:44:06.413217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 461/911] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:06 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:06.563392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-456d940f-d100-470c-828e-adf994fc37e6 req-877c7434-c9a7-46ea-a974-dc7a94cef618 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c97655f-b4c4-4378-ada2-dac458762af0", "name": "network-vif-plugged", "status": "completed", "tag": "2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:06.573091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-456d940f-d100-470c-828e-adf994fc37e6 req-877c7434-c9a7-46ea-a974-dc7a94cef618 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:06.573805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-456d940f-d100-470c-828e-adf994fc37e6 req-877c7434-c9a7-46ea-a974-dc7a94cef618 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:06.584735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-456d940f-d100-470c-828e-adf994fc37e6 req-877c7434-c9a7-46ea-a974-dc7a94cef618 service nova] Creating event network-vif-plugged:2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb for instance 3c97655f-b4c4-4378-ada2-dac458762af0 on hv-cinder-79987 Jul 29 14:44:06.589562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-456d940f-d100-470c-828e-adf994fc37e6 req-877c7434-c9a7-46ea-a974-dc7a94cef618 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029970 Jul 29 14:44:06.590133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 451/912] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:06.790365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:06.791022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:06.797025 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:06.797477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:06.798501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:06.798951 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:06.962511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:06.970127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-df40ae97-f6c0-49ba-beeb-217817613fff tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1451 microversion: 2.1 time: 0.184179 Jul 29 14:44:06.970720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 462/913] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:06 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:06.992022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:06.992724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:07.001066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:07.001066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:07.001066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:07.001476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:07.136724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:07.144250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad215d08-930d-4d04-833b-0917d38f59b3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1451 microversion: 2.1 time: 0.156952 Jul 29 14:44:07.144810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 452/914] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:06 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:07.434446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:07.435138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:07.441450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:07.441901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:07.442671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:07.443111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:07.644599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:07.652327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ccfd8ba2-8200-4cec-b4ba-daf84ca213bb tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1363 microversion: 2.1 time: 0.221899 Jul 29 14:44:07.652902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 463/915] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:07 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:08.674810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:08.675736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:08.688055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:08.688835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:08.689861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:08.690506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:08.923872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:08.935358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-056f1e96-d26c-40f3-bcf0-dfe1406a3a11 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1548 microversion: 2.1 time: 0.264576 Jul 29 14:44:08.949728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 453/916] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:08 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1548 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:08.957481 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:08.958587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:08.965268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:08.965724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:08.966510 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:08.967142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:09.107683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-762f5e74-c991-42d5-b2db-3d49f86b22ad tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154232 Jul 29 14:44:09.108442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 464/917] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:44:08 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:09.274508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-7a507ff7-19c4-4645-a97d-6a66996a3882 req-59257d9b-e90b-4a07-aa42-4a15320fedff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd5b621-deb0-400f-8a0c-53cf309b634c", "tag": "fca761d5-971a-4e4c-bae3-800888a36beb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:09.284262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7a507ff7-19c4-4645-a97d-6a66996a3882 req-59257d9b-e90b-4a07-aa42-4a15320fedff service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:09.284711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7a507ff7-19c4-4645-a97d-6a66996a3882 req-59257d9b-e90b-4a07-aa42-4a15320fedff service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:09.296787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-7a507ff7-19c4-4645-a97d-6a66996a3882 req-59257d9b-e90b-4a07-aa42-4a15320fedff service nova] Creating event network-changed:fca761d5-971a-4e4c-bae3-800888a36beb for instance ddd5b621-deb0-400f-8a0c-53cf309b634c on hv-cinder-79987 Jul 29 14:44:09.302465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-7a507ff7-19c4-4645-a97d-6a66996a3882 req-59257d9b-e90b-4a07-aa42-4a15320fedff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032205 Jul 29 14:44:09.303300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 454/918] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:10.271556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-62e404a5-95fb-42fb-bc41-09cb5c3914e1 req-2bad506b-abb3-4305-b059-3493375fbaef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c97655f-b4c4-4378-ada2-dac458762af0", "tag": "2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:10.282903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-62e404a5-95fb-42fb-bc41-09cb5c3914e1 req-2bad506b-abb3-4305-b059-3493375fbaef service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:10.283761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-62e404a5-95fb-42fb-bc41-09cb5c3914e1 req-2bad506b-abb3-4305-b059-3493375fbaef service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:10.297608 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-62e404a5-95fb-42fb-bc41-09cb5c3914e1 req-2bad506b-abb3-4305-b059-3493375fbaef service nova] Creating event network-changed:2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb for instance 3c97655f-b4c4-4378-ada2-dac458762af0 on hv-cinder-79987 Jul 29 14:44:10.304009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-62e404a5-95fb-42fb-bc41-09cb5c3914e1 req-2bad506b-abb3-4305-b059-3493375fbaef service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036603 Jul 29 14:44:10.306118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 465/919] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:16.357318 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:16.357912 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:16.364355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:16.364805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:16.365641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:16.366081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:16.393451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b966140d-7355-418a-863b-8f8ab9baae2e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/ips" status: 200 len: 148 microversion: 2.1 time: 0.038606 Jul 29 14:44:16.393451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 455/920] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:44:16 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:19.051896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7143b4f-186f-49d8-8779-d52cf7b88db8"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:19.054355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:19.057481 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:19.062397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:19.062864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:19.063612 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:19.064044 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:19.139369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:19.907113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a4b71fd7-0b0d-4f67-826a-f56f30b115fd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.859673 Jul 29 14:44:19.907744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 466/921] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:44:19 2022] POST /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments => generated 194 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:28.481098 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7143b4f-186f-49d8-8779-d52cf7b88db8"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:28.483415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:28.486065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=4 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:28.486728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=92 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:28.491456 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.491904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.492675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.493141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.572298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: POST /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments HTTP/1.1 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 74 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:44:28.574581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {"volumeAttachment": {"volumeId": "c7143b4f-186f-49d8-8779-d52cf7b88db8"}} Jul 29 14:44:28.576260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'server_id': '2e6d02d4-eb24-41e9-b261-4ba55250bf1d', 'body': {'volumeAttachment': {'volumeId': 'c7143b4f-186f-49d8-8779-d52cf7b88db8'}}} Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:44:28.577466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:28.578911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 400 to user: Invalid volume: volume c7143b4f-186f-49d8-8779-d52cf7b88db8 is already attached to instances: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-28fe7f82-63ec-4f48-90e1-4b8cdcdb9e5f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099535 Jul 29 14:44:28.580457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 456/922] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:44:28 2022] POST /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:44:28.640547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:28.641170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:28.647945 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.648326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.649114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.649549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.728055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'services' on Instance uuid 2e6d02d4-eb24-41e9-b261-4ba55250bf1d {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:44:28.936209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1f8daa2e-2a6b-47a3-8269-4ff45117d86c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments/c7143b4f-186f-49d8-8779-d52cf7b88db8" status: 202 len: 0 microversion: 2.1 time: 0.299615 Jul 29 14:44:28.936757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 467/923] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:44:28 2022] DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments/c7143b4f-186f-49d8-8779-d52cf7b88db8 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:44:28.945093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:28.947349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:28.955308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.957849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.957849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:28.957849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:28.986354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-68ba25e9-6464-42b9-9438-dc052f114157 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045215 Jul 29 14:44:28.986908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 457/924] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:44:28 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:30.001256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:30.003678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:30.009850 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:30.011246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:30.011729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:30.012164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:30.045102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ecd81514-12e6-448c-adad-84c4fa0d287e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Jul 29 14:44:30.045648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 468/925] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:44:29 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:31.057876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:31.060047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:31.066515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.066963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.067732 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.068199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.096128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f4ec647b-0c41-4c03-87d8-1e461134fdfb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042195 Jul 29 14:44:31.096672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 458/926] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:44:31 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:44:31.156849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:31.157402 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:31.163583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.164032 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.164797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.165254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.190625 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:44:31.442264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a5eb6fdb-d66e-4f00-9cd2-7eb01c5ba7e5 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 204 len: 0 microversion: 2.1 time: 0.288835 Jul 29 14:44:31.442809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 469/927] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:44:31 2022] DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:44:31.452044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:31.452869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:31.458983 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.459435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.460192 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:31.460625 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:31.594092 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:31.601558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5d0ab915-966e-43a0-9152-2bec209cf67c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1679 microversion: 2.1 time: 0.154361 Jul 29 14:44:31.602108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 459/928] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:31 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:32.623773 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:32.624479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:32.630993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:32.631449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:32.632246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:32.632691 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:32.760130 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:32.768393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a5cbd146-1468-49bb-8e44-b3e108ad5d3e tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1679 microversion: 2.1 time: 0.148851 Jul 29 14:44:32.768955 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 470/929] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:32 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:33.790375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:33.791002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:33.798407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:33.798857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:33.799657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:33.800091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:33.930480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:33.938819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-be334e2b-07d6-44f0-934a-5d1827168e13 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1679 microversion: 2.1 time: 0.152310 Jul 29 14:44:33.939388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 460/930] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:33 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:34.959787 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:34.960399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:34.967558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:34.968017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:34.968795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:34.969262 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:35.061916 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-d645cedd-83b8-45e0-9bb9-f41f21e5d4dd req-d01eb09e-e75b-41ff-9fee-69bc6c59e280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e6d02d4-eb24-41e9-b261-4ba55250bf1d", "name": "network-vif-deleted", "tag": "6fb007ce-b3f6-42ce-9f27-2522151054f4"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:35.062433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:35.070513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8d7a50e3-a7be-4ddf-864a-bebb5c308514 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1611 microversion: 2.1 time: 0.114508 Jul 29 14:44:35.071806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 471/931] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:34 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1611 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:35.085613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d645cedd-83b8-45e0-9bb9-f41f21e5d4dd req-d01eb09e-e75b-41ff-9fee-69bc6c59e280 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:35.086074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d645cedd-83b8-45e0-9bb9-f41f21e5d4dd req-d01eb09e-e75b-41ff-9fee-69bc6c59e280 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:35.098343 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-d645cedd-83b8-45e0-9bb9-f41f21e5d4dd req-d01eb09e-e75b-41ff-9fee-69bc6c59e280 service nova] Creating event network-vif-deleted:6fb007ce-b3f6-42ce-9f27-2522151054f4 for instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d on hv-cinder-79987 Jul 29 14:44:35.104356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-d645cedd-83b8-45e0-9bb9-f41f21e5d4dd req-d01eb09e-e75b-41ff-9fee-69bc6c59e280 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046058 Jul 29 14:44:35.104950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 461/932] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:44:35.376959 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:35.377492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:35.383456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:35.383907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:35.384677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:35.385149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:35.408265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-45104c0e-a462-4513-b2fd-c8a1dc3eae4a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/ips" status: 200 len: 153 microversion: 2.20 time: 0.035078 Jul 29 14:44:35.409013 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 472/933] 10.222.0.49 () {60 vars in 1289 bytes} [Fri Jul 29 14:44:35 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 29 14:44:36.093518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:36.094414 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:36.100671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:36.101174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:36.101954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:36.102399 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:36.143697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:36.153409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:36.154140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'fault' on Instance uuid 2e6d02d4-eb24-41e9-b261-4ba55250bf1d {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:44:36.198589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:36.206808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5b9e26c4-ce3c-47d3-ae21-1416f1e3e81a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 200 len: 1330 microversion: 2.1 time: 0.118742 Jul 29 14:44:36.207360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 462/934] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:36 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 1330 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:37.236318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:37.236877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:37.243279 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:37.243727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:37.244483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:37.244915 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:37.259024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d HTTP/1.1 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:44:37.260653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:44:37.262367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '2e6d02d4-eb24-41e9-b261-4ba55250bf1d'} Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:44:37.263826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:44:37.265365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:44:37.266811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:44:37.266811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a0e0aac7-0979-45cf-ab4e-98776cddfd54 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 404 len: 111 microversion: 2.1 time: 0.029680 Jul 29 14:44:37.266811 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 473/935] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:37 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:44:37.271959 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6726f8c9-654e-4200-9d8a-a12ea1d821bd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '.version_select at 0x7f68103f4af0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:37.337568 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6726f8c9-654e-4200-9d8a-a12ea1d821bd tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-951729339" status: 202 len: 0 microversion: 2.1 time: 0.069398 Jul 29 14:44:37.338131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 463/936] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 14:44:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-951729339 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:44:38.080853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f75920ad-9d35-4fde-884b-15c3942dc21b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: .version_select at 0x7f6810292af0>, body: {"keypair": {"name": "tempest-keypair-289384343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKtgfkx5GE05f1+dIkASOBvBrKVBWuJzBwM2bWwlxCDHgQkjoCpDHixQ9hbSntS18pfZPFe6KshanOZURokEkB3NArDLql2EvlVgRz3abbxvDl9wzdltkwQZK1T2aroRLQ=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:38.097575 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f75920ad-9d35-4fde-884b-15c3942dc21b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:44:38.101430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-f75920ad-9d35-4fde-884b-15c3942dc21b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:44:38.201295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f75920ad-9d35-4fde-884b-15c3942dc21b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124342 Jul 29 14:44:38.202086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 474/937] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:44:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:44:38.751345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:38.751876 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:38.759016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:38.759466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:38.760230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:38.760669 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:38.782422 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lazy-loading 'flavor' on Instance uuid ee43a21b-7169-4399-8904-ae6bf95ee322 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:44:39.234895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6366e989-fd65-415f-9850-206e6e773dc8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/action" status: 202 len: 0 microversion: 2.20 time: 0.488301 Jul 29 14:44:39.235824 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 464/938] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 14:44:38 2022] POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:44:39.245331 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:39.246004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:39.253120 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:39.253571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:39.254381 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:39.254813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:39.459498 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:39.467547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:39.469074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:39.470244 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-fa204982-e32c-40a0-a577-6219187fe0fe tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.229808 Jul 29 14:44:39.470847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 475/939] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:39 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:40.498370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:40.498370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:40.504218 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1333376173", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5b59a034-1f9b-4894-a9bb-b8f2d507494e"}], "security_groups": [{"name": "tempest-securitygroup--1083011189"}], "key_name": "tempest-keypair-289384343", "user_data": "}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:40.505133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:40.505581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:40.506349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:40.506963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:40.611288 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] validate_networks() for [('5b59a034-1f9b-4894-a9bb-b8f2d507494e', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:44:40.640519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:40.648350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:40.649977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:40.651184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e4d80f9f-6862-4c75-9e11-6f56e88e1a6f tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.160190 Jul 29 14:44:40.651928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 465/940] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:40 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:40.976452 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:44:40.976885 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:44:40.977393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:44:40.977808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:44:40.978223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:44:40.987839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:40.988291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:40.989140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:40.989578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:41.006549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:44:41.010383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Getting quotas for user 30432a068ad8486db8af635e66776f90 and project 1776579056dd420d81368ec51e2ddb95. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:44:41.021778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:44:41.024111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:44:41.199364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-43d9a1bb-e03c-419a-85f6-af5300535352 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.699223 Jul 29 14:44:41.200127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 476/941] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:44:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:44:41.211109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2bfc0f61-9134-49d0-9631-8dfa4cb9c852 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:41.211807 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2bfc0f61-9134-49d0-9631-8dfa4cb9c852 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:41.267323 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2bfc0f61-9134-49d0-9631-8dfa4cb9c852 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:41.274838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2bfc0f61-9134-49d0-9631-8dfa4cb9c852 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1241 microversion: 2.1 time: 0.067690 Jul 29 14:44:41.275395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 466/942] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:41 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:41.675063 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:41.675673 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:41.682471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:41.686217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:41.686217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:41.686217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:41.819877 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:41.828024 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:41.829683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:41.830839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-48a3ba31-c43c-4895-a8d6-8d42b7dd4476 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.160202 Jul 29 14:44:41.831395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 477/943] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:41 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:42.295417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:42.296036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:42.303726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:42.304176 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:42.304951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:42.305415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:42.369195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:42.377252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c08766b1-dfbe-4dc2-ad87-eb5473fbd0e9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1237 microversion: 2.1 time: 0.085930 Jul 29 14:44:42.377838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 467/944] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:42 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:42.854007 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:42.854611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:42.863112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:42.863570 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:42.864348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:42.864785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:42.994183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:43.003693 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:43.005222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:43.006371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cded0af7-00ef-4264-bb01-8624859b7f3a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.156253 Jul 29 14:44:43.011240 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 478/945] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:42 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:43.399703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:43.400325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:43.408187 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:43.408561 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:43.409358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:43.409790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:43.475289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:43.483430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-30fb0c17-8922-4700-955c-b6b8b5856ed8 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1311 microversion: 2.1 time: 0.087579 Jul 29 14:44:43.483990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 468/946] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:43 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:44.030511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:44.031145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:44.038223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:44.038701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:44.039556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:44.046216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:44.185681 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:44.195426 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:44.197391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:44.198712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-30749a62-3fb8-4137-b1d4-1847717d2b1a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.172341 Jul 29 14:44:44.199294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 479/947] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:44 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:44.505147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:44.505771 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:44.512273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:44.512826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:44.513679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:44.514125 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:44.646199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:44.653822 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-aad99b4a-d5e6-4276-8f40-fa8bf9a83891 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.152314 Jul 29 14:44:44.654381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 469/948] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:44 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:44.893142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-dd92ecb1-92c5-4ecd-9364-573a18dc9d11 req-97d36879-a7c9-4df4-a770-723de02c7b07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d41dbf-6b3c-4c81-872f-424cb32c445b", "tag": "19ddc3be-17e4-445f-81f6-48955f909d0b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:44.903155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-dd92ecb1-92c5-4ecd-9364-573a18dc9d11 req-97d36879-a7c9-4df4-a770-723de02c7b07 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:44.903968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-dd92ecb1-92c5-4ecd-9364-573a18dc9d11 req-97d36879-a7c9-4df4-a770-723de02c7b07 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:44.915386 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-dd92ecb1-92c5-4ecd-9364-573a18dc9d11 req-97d36879-a7c9-4df4-a770-723de02c7b07 service nova] Creating event network-changed:19ddc3be-17e4-445f-81f6-48955f909d0b for instance 87d41dbf-6b3c-4c81-872f-424cb32c445b on hv-cinder-79987 Jul 29 14:44:44.922295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-dd92ecb1-92c5-4ecd-9364-573a18dc9d11 req-97d36879-a7c9-4df4-a770-723de02c7b07 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034407 Jul 29 14:44:44.923410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 480/949] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:45.222793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:45.223433 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:45.230234 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:45.230772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:45.232103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:45.232547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:45.363861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:45.371903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:45.373415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:45.374579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c849c170-b8ba-421b-8d49-e7257491a4f0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.155883 Jul 29 14:44:45.375130 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 470/950] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:45 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:45.676179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:45.676870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:45.683596 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:45.684034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:45.685529 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:45.685968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:45.814221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:45.821592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-026c6177-fda0-4a10-9b78-12028c7a563c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.149869 Jul 29 14:44:45.822136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 481/951] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:45 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:46.398793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:46.399395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:46.406695 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:46.407082 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:46.407840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:46.408273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:46.537506 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:46.546743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:46.548495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:46.549672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f6105ed6-110a-4288-8279-c6caad99a60c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.154943 Jul 29 14:44:46.550222 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 471/952] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:46 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:46.843149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:46.843760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:46.850164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:46.850609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:46.851367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:46.851798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:46.983582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:46.990899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a7b0e09-c357-4430-b78c-626247098d83 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.152324 Jul 29 14:44:46.991480 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 482/953] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:46 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:47.572743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:47.573377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:47.579908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:47.580355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:47.581145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:47.581586 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:47.707799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:47.711306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:47.716682 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:47.718213 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:47.719363 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5cdf3ca8-7e32-458d-90ef-de064db4eeba tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.150547 Jul 29 14:44:47.719908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 472/954] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:47 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:48.014029 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:48.014697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:48.021294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:48.021741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:48.022512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:48.022945 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:48.027026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:48.229511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:48.237363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4c238902-55d7-4fac-87ec-4a35031d3ca9 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.228324 Jul 29 14:44:48.237944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 483/955] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:48 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:48.751141 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:48.751760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:48.758896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:48.759424 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:48.760194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:48.760631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:48.891747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:48.899679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:48.901346 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:48.902442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-78a4854f-31d4-4f2f-b11e-e0a454bffe7d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.155870 Jul 29 14:44:48.903535 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 473/956] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:48 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:49.258702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:49.259320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:49.261624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:49.266553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:49.267007 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:49.267782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:49.268227 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:49.399664 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:49.407371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a2a52896-e5b9-4c84-a5b3-413d5b654d8c tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.152488 Jul 29 14:44:49.407879 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 484/957] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:49 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:49.926184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:49.926828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:49.933923 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:49.934445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:49.935209 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:49.935645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:50.067679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:50.076258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:50.077805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:50.078969 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-625e9a91-0688-4189-9573-8e2c3e4f8d4d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.156988 Jul 29 14:44:50.079564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 474/958] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:49 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:50.429193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:50.429803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:50.436822 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:50.437289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:50.438051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:50.438492 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:50.566702 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:50.574178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a6eb40b0-66ff-44d2-bcbf-f1dacf5c56f3 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.148821 Jul 29 14:44:50.574739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 485/959] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:50 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:50.810805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-768e2f05-1ef9-4c7c-9feb-ed559e8832dd req-d065f50c-807b-45f0-afed-d5268e25859e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d41dbf-6b3c-4c81-872f-424cb32c445b", "name": "network-vif-plugged", "status": "completed", "tag": "19ddc3be-17e4-445f-81f6-48955f909d0b"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:50.820292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-768e2f05-1ef9-4c7c-9feb-ed559e8832dd req-d065f50c-807b-45f0-afed-d5268e25859e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:50.820732 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-768e2f05-1ef9-4c7c-9feb-ed559e8832dd req-d065f50c-807b-45f0-afed-d5268e25859e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:50.831225 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-768e2f05-1ef9-4c7c-9feb-ed559e8832dd req-d065f50c-807b-45f0-afed-d5268e25859e service nova] Creating event network-vif-plugged:19ddc3be-17e4-445f-81f6-48955f909d0b for instance 87d41dbf-6b3c-4c81-872f-424cb32c445b on hv-cinder-79987 Jul 29 14:44:50.836175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-768e2f05-1ef9-4c7c-9feb-ed559e8832dd req-d065f50c-807b-45f0-afed-d5268e25859e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029841 Jul 29 14:44:50.836757 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 475/960] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:51.102785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:51.103333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:51.105231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:51.105893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=10 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:51.111865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:51.112321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:51.113184 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:51.113630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:51.534338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:51.542223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:51.544354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:51.545544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1981604e-1b66-4e5e-9287-5b9418417a7c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.446917 Jul 29 14:44:51.546105 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 486/961] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:51 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:51.592552 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:51.596721 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:51.597448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:51.603593 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:51.604039 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:51.604802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:51.605271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:51.733988 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:51.741292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9175b4c3-9030-450e-a4f7-fdd57e519ccb tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.150075 Jul 29 14:44:51.741849 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 476/962] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:51 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:52.569429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:52.570068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:52.577188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:52.577640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:52.578404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:52.578842 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:52.704461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:52.712221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:52.713769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:52.714906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d1ba7a4a-ae79-4a05-856c-35d3b0ca38e7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.149418 Jul 29 14:44:52.716018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 487/963] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:52 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:52.763360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:52.764075 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:52.770709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:52.771161 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:52.771939 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:52.772367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:52.903915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:52.911668 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-735f725b-60d6-4d8e-bb47-73b80915e724 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.152236 Jul 29 14:44:52.912232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 477/964] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:52 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:44:53.901157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:53.901157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:53.901157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:53.901157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:53.903141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:53.903141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:53.903141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:53.903417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:53.903417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:53.903417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1408963b-5c04-4ed5-aa93-cf65740804e5 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.152699 Jul 29 14:44:53.903703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 488/965] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:53 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:53.932872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:53.933523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:53.940699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:53.941183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:53.941953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:53.942402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:54.073181 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:54.080953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a58dc6f7-ce77-4b39-9892-1ed175b125c1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1367 microversion: 2.1 time: 0.151869 Jul 29 14:44:54.081541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 478/966] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:53 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:54.909413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:54.910031 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:54.916392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:54.916835 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:54.917630 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:54.918064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:55.048631 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:55.056839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:55.058398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:55.059578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e9f5805-3298-4727-b2bc-4ba7181f83cf tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.154025 Jul 29 14:44:55.060125 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 489/967] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:54 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:55.101478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:55.102095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:55.110987 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:55.111437 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:55.112274 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:55.112714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:55.251622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:55.259026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4df3af5a-1d95-4f44-88cb-753324ad2f06 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1556 microversion: 2.1 time: 0.161482 Jul 29 14:44:55.259705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 479/968] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:44:55 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:44:55.279441 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:55.279939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:55.286020 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:55.286465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:55.287228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:55.287662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:55.363158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1323d3ef-0d00-4793-9349-eaa4e0dde09d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087643 Jul 29 14:44:55.363760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 490/969] 10.222.0.49 () {58 vars in 1275 bytes} [Fri Jul 29 14:44:55 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:56.082723 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:56.083341 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:56.089388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:56.089843 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:56.090626 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:56.091117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:56.225018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:56.233647 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:56.235178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:56.236579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e8de78e6-ad9a-4bb6-a3e0-7268bfde1e32 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1746 microversion: 2.20 time: 0.157629 Jul 29 14:44:56.236904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 480/970] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:56 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:56.338528 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-4ef48b4a-701b-4708-9d0c-47d004df8c29 req-87eb058c-22f1-4e27-bd13-69db6bf045a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87d41dbf-6b3c-4c81-872f-424cb32c445b", "tag": "19ddc3be-17e4-445f-81f6-48955f909d0b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:44:56.347798 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4ef48b4a-701b-4708-9d0c-47d004df8c29 req-87eb058c-22f1-4e27-bd13-69db6bf045a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:56.348246 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-4ef48b4a-701b-4708-9d0c-47d004df8c29 req-87eb058c-22f1-4e27-bd13-69db6bf045a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:56.359314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-4ef48b4a-701b-4708-9d0c-47d004df8c29 req-87eb058c-22f1-4e27-bd13-69db6bf045a1 service nova] Creating event network-changed:19ddc3be-17e4-445f-81f6-48955f909d0b for instance 87d41dbf-6b3c-4c81-872f-424cb32c445b on hv-cinder-79987 Jul 29 14:44:56.364368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-4ef48b4a-701b-4708-9d0c-47d004df8c29 req-87eb058c-22f1-4e27-bd13-69db6bf045a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029940 Jul 29 14:44:56.365053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 491/971] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:44:57.259804 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:57.260423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:57.267297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:57.267754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:57.268546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:57.269003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:57.400115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:57.408940 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:57.410479 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:57.411642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8b8fb05c-2267-494d-bfd6-73c84b77e25e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1746 microversion: 2.20 time: 0.155866 Jul 29 14:44:57.412375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 481/972] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:57 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:58.437930 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:58.438542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:58.444720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:58.445196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:58.445956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:58.446389 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:58.573897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:58.581944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:58.583462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:58.584622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-338a7087-9fb6-459e-9fc0-d94b88fa5f1c tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1746 microversion: 2.20 time: 0.152664 Jul 29 14:44:58.585207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 492/973] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:58 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:44:59.608940 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:44:59.609615 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:44:59.611981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:44:59.616803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:59.617292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:59.618069 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:44:59.618508 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:44:59.750842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:59.758640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:59.760129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:44:59.761296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6cbc3b19-e221-42eb-a88b-8ca6e3c20344 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1746 microversion: 2.20 time: 0.157249 Jul 29 14:44:59.761841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 482/974] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:44:59 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:00.785487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:00.789475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:00.792979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-ba8a172b-a854-48c5-b285-9224f6fe9b37 req-659d61de-cfd0-4c4a-b8ed-264b3d7f831c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "name": "network-vif-plugged", "status": "completed", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:00.793679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:00.794145 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:00.795635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:00.796090 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:00.803862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ba8a172b-a854-48c5-b285-9224f6fe9b37 req-659d61de-cfd0-4c4a-b8ed-264b3d7f831c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:00.804306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ba8a172b-a854-48c5-b285-9224f6fe9b37 req-659d61de-cfd0-4c4a-b8ed-264b3d7f831c service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:00.815851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-ba8a172b-a854-48c5-b285-9224f6fe9b37 req-659d61de-cfd0-4c4a-b8ed-264b3d7f831c service nova] Creating event network-vif-plugged:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:45:00.821158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-ba8a172b-a854-48c5-b285-9224f6fe9b37 req-659d61de-cfd0-4c4a-b8ed-264b3d7f831c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031673 Jul 29 14:45:00.821764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 483/975] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:00.946101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:00.956036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:00.957588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:00.958745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0e3122d9-7237-4389-9cba-fa98a7fb21f4 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.177651 Jul 29 14:45:00.959314 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 493/976] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:00 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:01.985230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:01.986641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:01.993762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:01.994372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:01.995250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:01.995951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:02.139571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:02.148280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:02.152359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:02.153652 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7b1d445d-8659-455a-8470-429e8ca62d60 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.174597 Jul 29 14:45:02.154742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 484/977] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:01 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:03.176093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:03.176874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:03.184333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:03.184867 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:03.187089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:03.187764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:03.338727 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:03.349825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:03.351324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:03.352490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-310f353b-5204-4124-ad18-27ca7404d141 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.180700 Jul 29 14:45:03.353060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 494/978] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:03 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:04.377600 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:04.378149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:04.386095 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:04.386551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:04.387325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:04.387762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:04.520056 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:04.528201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:04.530242 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:04.531407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c32d43e3-7fcc-486b-aabc-e7a62a9b20cc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.158511 Jul 29 14:45:04.531963 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 485/979] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:04 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:05.555962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:05.557410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:05.566466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:05.567218 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:05.568072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:05.569791 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:05.723967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:05.735715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:05.738232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:05.739533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0fa29b48-e130-448c-b970-a3669f91c1e2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.187805 Jul 29 14:45:05.740320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 495/980] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:05 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:06.764067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:06.765081 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:06.772153 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:06.772611 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:06.773531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:06.774119 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:06.927261 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:06.936123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:06.937676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:06.938885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8b32b77a-3212-4347-99ef-ff56723b6b29 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.179674 Jul 29 14:45:06.939460 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 486/981] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:06 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:07.963889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:07.964557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:07.972938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:07.973921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:07.974722 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:07.975318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:08.146003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:08.163990 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:08.165738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:08.167263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-73c84fef-8396-46b3-a50f-3bacf081c205 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.207317 Jul 29 14:45:08.168444 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 496/982] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:07 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:09.197575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:09.198217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:09.205395 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:09.205792 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:09.206579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:09.207027 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:09.356666 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:09.366539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:09.372143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:09.373762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d5c6cd9d-9352-48af-8231-13d494845f0e tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.180573 Jul 29 14:45:09.387063 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 487/983] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:09 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:10.398322 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:10.399121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:10.406757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:10.407138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:10.408027 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:10.408495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:10.547986 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:10.562537 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:10.564052 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:10.565240 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3d730793-1898-4259-8ba3-fd1409756fe6 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.170963 Jul 29 14:45:10.565796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 497/984] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:10 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:11.589006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:11.589639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:11.596640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:11.597120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:11.597904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:11.598341 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:11.739528 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:11.748053 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:11.749683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:11.750850 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c5ad60e2-2f03-479e-a600-b0433224f168 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.165823 Jul 29 14:45:11.751401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 488/985] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:11 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:12.773661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:12.774259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:12.780695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:12.781179 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:12.781942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:12.782374 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:12.911815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:12.919725 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:12.921923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:12.923338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-81e733f5-6f4e-446e-9a80-1cdfc01bffb2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1741 microversion: 2.20 time: 0.153596 Jul 29 14:45:12.923893 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 498/986] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:12 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:13.945989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:13.946605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:13.953202 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:13.953654 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:13.954418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:13.954860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:14.083036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:14.090976 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:14.092671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:14.094064 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2c6c633f-cdf5-403c-8d96-db46693c7663 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1723 microversion: 2.20 time: 0.152014 Jul 29 14:45:14.094643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 489/987] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:13 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:15.117319 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:15.118008 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:15.124522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:15.124972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:15.125769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:15.126212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:15.255545 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:15.263396 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:15.265671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:15.266840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7512d916-8457-4e2c-be84-ca7d31e943bc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1723 microversion: 2.20 time: 0.153523 Jul 29 14:45:15.267394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 499/988] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:15 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:16.290178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:16.290795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:16.297928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:16.298384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:16.299158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:16.299603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:16.433482 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:16.438308 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:16.443573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:16.445088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:16.446236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-301e30b2-51c7-4756-9c58-418cf80f8eeb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1726 microversion: 2.20 time: 0.160063 Jul 29 14:45:16.446807 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 490/989] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:16 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:16.470283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29571cb2-f218-4119-b7db-5f8c1470d572"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:16.472642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:16.479830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:16.480343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:16.481257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:16.481761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:16.556157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=100 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:16.866118 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-c5ea9c57-c038-402f-915e-59ec8c82fd6e req-51e1c0eb-f517-4166-b7e5-845c17b676a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "name": "network-vif-unplugged", "status": "completed", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:16.875917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c5ea9c57-c038-402f-915e-59ec8c82fd6e req-51e1c0eb-f517-4166-b7e5-845c17b676a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:16.876370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-c5ea9c57-c038-402f-915e-59ec8c82fd6e req-51e1c0eb-f517-4166-b7e5-845c17b676a1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:16.887012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.compute.server_external_events [req-c5ea9c57-c038-402f-915e-59ec8c82fd6e req-51e1c0eb-f517-4166-b7e5-845c17b676a1 service nova] Unable to find a host for instance ee43a21b-7169-4399-8904-ae6bf95ee322. Dropping event network-vif-unplugged {{(pid=124772) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 14:45:16.887879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-c5ea9c57-c038-402f-915e-59ec8c82fd6e req-51e1c0eb-f517-4166-b7e5-845c17b676a1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025975 Jul 29 14:45:16.888439 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 491/990] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:45:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 29 14:45:17.552415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7c5b9f06-327b-4751-b07c-c4ce5da6313b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.086667 Jul 29 14:45:17.553316 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 500/991] 10.222.0.49 () {62 vars in 1364 bytes} [Fri Jul 29 14:45:16 2022] POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments => generated 188 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 29 14:45:17.673931 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:17.674430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:17.680875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:17.681357 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:17.682131 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:17.682573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:18.240940 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4cf30fac-cc8e-47f2-a6f5-ea6fdc2a4ee9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments/29571cb2-f218-4119-b7db-5f8c1470d572" status: 202 len: 0 microversion: 2.20 time: 0.571609 Jul 29 14:45:18.241519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 492/992] 10.222.0.49 () {60 vars in 1457 bytes} [Fri Jul 29 14:45:17 2022] DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments/29571cb2-f218-4119-b7db-5f8c1470d572 => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:45:18.301513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:18.302107 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:18.308080 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:18.308525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:18.309340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:18.309813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:18.339524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124771) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 14:45:18.606104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-b860fa6c-fc8d-4796-82f6-1d916281b043 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/action" status: 202 len: 0 microversion: 2.20 time: 0.308773 Jul 29 14:45:18.606737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 501/993] 10.222.0.49 () {62 vars in 1319 bytes} [Fri Jul 29 14:45:18 2022] POST /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:45:18.615278 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:18.615892 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:18.621998 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:18.622450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:18.623230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:18.623667 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:18.761702 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:18.770366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:18.771870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:18.773041 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-294782b4-495b-40da-9127-a4daa0232271 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1674 microversion: 2.20 time: 0.161816 Jul 29 14:45:18.773687 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 493/994] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:18 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:19.796172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:19.796778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:19.798900 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:19.803676 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:19.804125 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:19.804911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:19.805367 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:19.939226 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:19.947195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:19.948690 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:19.949866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f4d0ad8d-b446-4df6-92d7-80dfe62e57c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1676 microversion: 2.20 time: 0.158249 Jul 29 14:45:19.950429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 502/995] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:19 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:20.980644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:20.981250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:20.988060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:20.988520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:20.989331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:20.989790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:21.124239 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:21.132266 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:21.133882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:21.135044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4323c777-0d30-4078-a112-06bddca38502 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.158406 Jul 29 14:45:21.135598 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 494/996] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:20 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:22.160186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:22.160801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:22.167682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:22.168131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:22.169127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:22.169566 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:22.303917 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:22.312320 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:22.313851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:22.315009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9d89b9bc-2703-4ab6-8f03-9038b1c5c4da tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.160187 Jul 29 14:45:22.315561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 503/997] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:22 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:23.338613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:23.339230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:23.345929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:23.346384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:23.347165 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:23.347605 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:23.481709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:23.500939 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:23.502476 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:23.503655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f1d73c5c-6100-43f2-a5b9-07401cfe574b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.168952 Jul 29 14:45:23.504219 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 495/998] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:23 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:24.527082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:24.527677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:24.535109 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:24.535558 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:24.536321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:24.536752 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:24.670587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:24.681586 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:24.684544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:24.687419 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7ea4a09e-309b-45ad-88ec-595c06d3157a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.163245 Jul 29 14:45:24.688445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 504/999] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:24 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:25.711757 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:25.712376 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:25.718954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:25.719404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:25.720164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:25.720594 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:25.853647 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:25.862481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:25.863984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:25.865232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3fad041a-a3f9-49a9-bdae-c9def0b27b0b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.157345 Jul 29 14:45:25.865977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 496/1000] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:25 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:26.889136 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:26.889706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:26.896421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:26.896901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:26.898047 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:26.898496 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:27.041134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:27.050686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:27.052019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:27.053235 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5cbd13e3-7729-47ee-8786-9f3595ddafa0 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.168122 Jul 29 14:45:27.053797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 505/1001] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:26 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:28.076350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:28.076968 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:28.084354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:28.084807 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:28.085623 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:28.086134 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:28.448263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:28.457421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:28.458971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:28.460166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3a3e8038-2add-434d-ad9e-6709744c15c1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.387903 Jul 29 14:45:28.461245 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 497/1002] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:28 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:29.483519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:29.484297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:29.491186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:29.491638 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:29.492416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:29.492853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:29.633265 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:29.641402 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:29.642962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:29.644679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-008a6222-cc5a-450f-8d3d-def9f1b7d334 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.165076 Jul 29 14:45:29.645269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 506/1003] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:29 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:30.667922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:30.668579 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:30.670826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=32 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:30.675995 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:30.681022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:30.681022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:30.681022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:30.811840 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:30.820247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:30.821784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:30.822944 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5da08f94-8769-4beb-8b6f-5c6f1cee6ad2 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.158973 Jul 29 14:45:30.823719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 498/1004] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:30 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:31.846749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:31.848507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:31.855258 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:31.855712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:31.856499 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:31.856942 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:31.996652 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:32.004888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:32.006426 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:32.007588 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ee4db0a7-5143-43ad-884f-94eaf0355b0a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.165047 Jul 29 14:45:32.008352 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 507/1005] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:31 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:33.031334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:33.031980 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:33.039143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:33.039593 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:33.040367 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:33.040805 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:33.347057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:33.354885 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:33.356384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:33.357567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e117d93a-3ca0-4695-93ec-82f35ec9bbfc tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.330130 Jul 29 14:45:33.358130 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 499/1006] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:33 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:34.381891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:34.382524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:34.389029 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:34.389479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:34.390234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:34.390667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:34.576590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:34.585738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:34.587251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:34.588388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2ad17ce2-e1e7-42f1-a33c-4c788d8a29d8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.211124 Jul 29 14:45:34.588948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 508/1007] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:34 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:35.611996 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:35.612760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:35.619445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:35.619898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:35.620675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:35.621145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:35.754207 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:35.762224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:35.763716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:35.764864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c442a70d-402d-42cd-b056-4f948adf4d18 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.156947 Jul 29 14:45:35.765445 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 500/1008] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:35 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:36.788455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:36.789085 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:36.795553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:36.796004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:36.797047 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:36.797487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:36.925174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:36.933775 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:36.935261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:36.936404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4394f9fa-38d3-49ab-9d8b-9704dafe4a57 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.152446 Jul 29 14:45:36.937089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 509/1009] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:36 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:37.959602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:37.960157 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:37.966730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:37.967173 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:37.967935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:37.968369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:38.102215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:38.110096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:38.111581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:38.112730 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e6519b8e-c84d-48bb-b0c7-2bbf0fec880b tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.157140 Jul 29 14:45:38.113884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 501/1010] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:37 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:39.135888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:39.136501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:39.142640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:39.143093 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:39.143872 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:39.144318 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:39.278730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:39.287360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:39.288846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:39.290116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-96ca5351-769b-4601-a30a-c9b07dba64e8 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.158044 Jul 29 14:45:39.290669 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 510/1011] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:39 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:39.844781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:39.845410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:39.851982 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:39.852443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:39.853220 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:39.853657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:39.876812 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f5ad17d0-e115-4963-b1d3-b79a673843c2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/ips" status: 200 len: 144 microversion: 2.1 time: 0.035749 Jul 29 14:45:39.877322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 502/1012] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:45:39 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/ips => generated 144 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:45:40.312938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:40.313601 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:40.320618 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:40.321103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:40.321870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:40.322307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:40.461507 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:40.469372 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:40.470928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:40.472004 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-be841827-ed48-46a2-9fbf-ac4e6c65863a tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.162988 Jul 29 14:45:40.473204 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 511/1013] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:40 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:41.011583 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-7e408639-8257-4a5f-8ca2-f611be8a5e94 req-d4c4cd0c-b7af-4de3-9cb7-3397dd0d8f85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "name": "network-vif-plugged", "status": "completed", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:41.021818 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7e408639-8257-4a5f-8ca2-f611be8a5e94 req-d4c4cd0c-b7af-4de3-9cb7-3397dd0d8f85 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:41.022274 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-7e408639-8257-4a5f-8ca2-f611be8a5e94 req-d4c4cd0c-b7af-4de3-9cb7-3397dd0d8f85 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:41.033262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-7e408639-8257-4a5f-8ca2-f611be8a5e94 req-d4c4cd0c-b7af-4de3-9cb7-3397dd0d8f85 service nova] Creating event network-vif-plugged:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:45:41.038455 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-7e408639-8257-4a5f-8ca2-f611be8a5e94 req-d4c4cd0c-b7af-4de3-9cb7-3397dd0d8f85 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030592 Jul 29 14:45:41.039031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 503/1014] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:45:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:41.495237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:41.495845 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:41.502479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:41.502931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:41.503699 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:41.504937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:41.632853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:41.641172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:41.642642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:41.643785 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a1511137-2057-4277-b2e3-710b4073d0d1 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.152532 Jul 29 14:45:41.644569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 512/1015] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:41 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:42.519803 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744f2d8d-f34d-4f9e-a6a3-52257671c34d"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:42.522290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:42.528409 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:42.528857 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:42.529663 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:42.530099 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:42.805993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:42.805993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:42.811631 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:42.811891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:42.812686 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:42.813196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:42.945747 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:42.949036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:42.953883 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:42.955365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:42.956502 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-df8ae4ad-2fa6-4910-84b9-5251806f2a6d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.293883 Jul 29 14:45:42.957730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 513/1016] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:42 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 29 14:45:43.271578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c6c690b8-5b4e-41ec-8d83-c7807f8c4401 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752598 Jul 29 14:45:43.271578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 504/1017] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:45:42 2022] POST /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:43.980899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:43.981595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:43.989555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:43.990715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:43.990855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:43.991296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:44.127577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:44.136108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:44.137624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:44.138765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-25828c03-d8a7-48c0-83bb-fea89996aa9d tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1732 microversion: 2.20 time: 0.162590 Jul 29 14:45:44.139317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 514/1018] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:43 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:45.164298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:45.165019 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:45.171302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:45.172021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:45.172799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:45.173270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:45.188687 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:45.305784 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:45.313653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:45.315139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:45:45.316313 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-423ebad5-0ec4-406d-8b27-2940e19075b9 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1719 microversion: 2.20 time: 0.157472 Jul 29 14:45:45.316865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 505/1019] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:45:45 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:45:51.844626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:51.846928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:51.849698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=26 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:45:51.854454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:51.854914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:51.855688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:51.856133 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:51.885182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5508fbd0-e713-4985-bad5-b41c8ab8437d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044381 Jul 29 14:45:51.885734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 515/1020] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:45:51 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:51.897290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:45:51.897822 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:51.904447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:51.904898 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:51.905699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:51.906143 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:51.934824 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8fb29d9d-95e1-4311-9038-a72fc54e8ab9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d" status: 200 len: 194 microversion: 2.1 time: 0.042444 Jul 29 14:45:51.935396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 506/1021] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 14:45:51 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:53.547196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f145792-ded8-4a62-a081-bd623e7feeb9"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:45:53.549684 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:45:53.556324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:53.556777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:53.557581 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:45:53.558021 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:45:54.282102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4a783c87-b3b9-4163-9db5-caeef0b9130d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "POST /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.739176 Jul 29 14:45:54.282742 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 516/1022] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:45:53 2022] POST /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 194 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:45:54.903427 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:45:54.903981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:45:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:46:02.857366 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:02.859626 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:02.862264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=17 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:02.863051 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=9 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:02.868345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:02.868800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:02.869612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:02.870055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:02.899630 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-62157de9-158d-48f2-a119-96cd9d2c87a2 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046224 Jul 29 14:46:02.900178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 507/1023] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:02 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:03.039658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:03.040215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:03.047292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:03.047746 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:03.048516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:03.048957 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:03.077446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-003f2079-b0aa-4ecf-9bda-26d9e934b3bd tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d" status: 200 len: 194 microversion: 2.1 time: 0.042097 Jul 29 14:46:03.078022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 517/1024] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 14:46:03 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:03.089544 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:03.090039 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:03.096468 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:03.096918 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:03.097832 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:03.098271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:03.180182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lazy-loading 'services' on Instance uuid 3c97655f-b4c4-4378-ada2-dac458762af0 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:46:03.383522 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f4f9016d-aa8c-47ce-9fe6-ec5964e788a6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d" status: 202 len: 0 microversion: 2.1 time: 0.297611 Jul 29 14:46:03.384105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 508/1025] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:46:03 2022] DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/744f2d8d-f34d-4f9e-a6a3-52257671c34d => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:46:05.556509 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:05.557071 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:05.563585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:05.564038 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:05.564801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:05.565264 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:05.593263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-001aa055-491a-4169-b546-a8a47d19dea3 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/7f145792-ded8-4a62-a081-bd623e7feeb9" status: 200 len: 194 microversion: 2.1 time: 0.040625 Jul 29 14:46:05.593825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 518/1026] 10.222.0.49 () {58 vars in 1413 bytes} [Fri Jul 29 14:46:05 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/7f145792-ded8-4a62-a081-bd623e7feeb9 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:05.605655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:05.606317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:05.612964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:05.613459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:05.614227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:05.614665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:05.693679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lazy-loading 'services' on Instance uuid 3c97655f-b4c4-4378-ada2-dac458762af0 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:46:05.917736 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a7e0bf4b-77e1-4e9f-9849-04bc779ffd1d tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/7f145792-ded8-4a62-a081-bd623e7feeb9" status: 202 len: 0 microversion: 2.1 time: 0.316036 Jul 29 14:46:05.918541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 509/1027] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:46:05 2022] DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments/7f145792-ded8-4a62-a081-bd623e7feeb9 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:46:08.149710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:08.152149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:08.159076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.160126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.160943 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.161398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.191533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ba345e14-fe6f-4578-8cde-6afe5f53a3ff tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045783 Jul 29 14:46:08.192129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 519/1028] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:08 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:46:08.304197 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:08.306554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:08.313310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.313770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.314537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.314979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.342349 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-46bb5142-f955-441a-a5ca-fd540c2d4fe9 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043050 Jul 29 14:46:08.342890 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 510/1029] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:08 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 29 14:46:08.402985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:08.403479 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:08.409987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.410467 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.411224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.411677 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.435952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:46:08.703495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6e03fe87-1dc9-4a5b-b2c4-becd6370d29c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 204 len: 0 microversion: 2.1 time: 0.304034 Jul 29 14:46:08.704001 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 520/1030] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:08 2022] DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:46:08.716447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:08.717113 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:08.723951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.724405 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.725231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:08.725675 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:08.854195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:08.861752 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-97faebd9-6303-422e-9dbc-bf085be38bc6 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1672 microversion: 2.1 time: 0.149304 Jul 29 14:46:08.862313 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 511/1031] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:08 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1672 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:09.884923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:09.885559 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:09.891939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:09.892385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:09.893184 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:09.893617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:10.308347 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:10.316726 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-37ff564b-48ce-48e6-b384-797664df86ba tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1672 microversion: 2.1 time: 0.435547 Jul 29 14:46:10.317392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 521/1032] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:09 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1672 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:11.338337 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:11.338962 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:11.345559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:11.346018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:11.346795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:11.347941 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:11.490973 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:11.498620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-05e4bbd1-d311-4911-a8b1-08f0f17fa4b8 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1672 microversion: 2.1 time: 0.164170 Jul 29 14:46:11.501039 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 512/1033] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:11 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1672 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:11.836880 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-70969b1f-f5b3-4015-8c4a-09b7f4e5e046 req-383365aa-5d93-4569-91a9-06819b2d4250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c97655f-b4c4-4378-ada2-dac458762af0", "name": "network-vif-deleted", "tag": "2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:11.846716 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-70969b1f-f5b3-4015-8c4a-09b7f4e5e046 req-383365aa-5d93-4569-91a9-06819b2d4250 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:11.848962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-70969b1f-f5b3-4015-8c4a-09b7f4e5e046 req-383365aa-5d93-4569-91a9-06819b2d4250 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:11.858494 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-70969b1f-f5b3-4015-8c4a-09b7f4e5e046 req-383365aa-5d93-4569-91a9-06819b2d4250 service nova] Creating event network-vif-deleted:2dd9a5eb-b4d8-47bf-8fbd-73961c88b5bb for instance 3c97655f-b4c4-4378-ada2-dac458762af0 on hv-cinder-79987 Jul 29 14:46:11.864014 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-70969b1f-f5b3-4015-8c4a-09b7f4e5e046 req-383365aa-5d93-4569-91a9-06819b2d4250 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031194 Jul 29 14:46:11.864608 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 522/1034] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:12.521671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:12.522319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:12.529317 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:12.529955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:12.531331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:12.531769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:12.564975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:12.565448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:12.566633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lazy-loading 'fault' on Instance uuid 3c97655f-b4c4-4378-ada2-dac458762af0 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:46:12.608596 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3a38dc21bc34164aea48065da64823f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44c869dc06224bf49f25fcf7aeb0e5a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:12.617458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6a42e034-69fd-4bd9-b5df-affd0f61810c tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 200 len: 1327 microversion: 2.1 time: 0.100746 Jul 29 14:46:12.618050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 513/1035] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:12 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:13.649283 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:13.649976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:13.656132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:13.656580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:13.657370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:13.657809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:13.673291 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 HTTP/1.1 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:13.674903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:13.676874 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '3c97655f-b4c4-4378-ada2-dac458762af0'} Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:13.677858 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:13.679430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:13.680912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:13.680912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-466b20aa-6403-4e7f-b7c6-5bf7bb59581e tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 404 len: 111 microversion: 2.1 time: 0.032448 Jul 29 14:46:13.680912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 523/1036] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:13 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:13.685172 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e7b22403-6f08-4b57-a8c5-5b2478163225 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '.version_select at 0x7f68101f0700>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:13.785059 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e7b22403-6f08-4b57-a8c5-5b2478163225 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015561879" status: 202 len: 0 microversion: 2.1 time: 0.103044 Jul 29 14:46:13.785725 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 514/1037] 10.222.0.49 () {58 vars in 1221 bytes} [Fri Jul 29 14:46:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1015561879 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:46:22.981028 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:22.981569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:22.988806 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:22.989392 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:22.990164 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:22.990604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:22.993074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:23.013688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-75e2647c-9eb8-4d46-9c54-6be4c6ba508b tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/ips" status: 200 len: 149 microversion: 2.1 time: 0.036693 Jul 29 14:46:23.014256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 524/1038] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:46:22 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:25.364195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:25.365110 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:25.369047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-479407571", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1345170100", "security_groups": [{"name": "tempest-secgroup-smoke-67867029"}], "block_device_mapping_v2": [{"uuid": "9362e96d-73cc-4844-bfaa-8b257fa3dae1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "16aee007-d69b-4d84-b034-615cf90e91d9"}]}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:25.482762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.network.neutron [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] validate_networks() for [('16aee007-d69b-4d84-b034-615cf90e91d9', None, None, None, None, None)] {{(pid=124772) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:46:25.544370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:25.544903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:25.548571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:25.553281 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.553754 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.554967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.555442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.569196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 HTTP/1.1 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:25.570758 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.579337 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '3c97655f-b4c4-4378-ada2-dac458762af0'} Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:25.580965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.583248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.584503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:25.584503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-875d1c7c-62f1-49f5-9ff2-2e8f21840c97 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 404 len: 111 microversion: 2.1 time: 0.032161 Jul 29 14:46:25.584503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 525/1039] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:25 2022] DELETE /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:46:25.588300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:25.588912 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3c97655f-b4c4-4378-ada2-dac458762af0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:25.595269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.596358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.598603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.599187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.614802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 HTTP/1.1 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:25.616861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.621442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '3c97655f-b4c4-4378-ada2-dac458762af0'} Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:25.622449 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. Jul 29 14:46:25.623923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:25.625627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3c97655f-b4c4-4378-ada2-dac458762af0 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:25.625627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-76e9dc36-152c-4afd-96f4-d2b553ab3f22 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0" status: 404 len: 111 microversion: 2.1 time: 0.033414 Jul 29 14:46:25.625627 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 526/1040] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:25 2022] GET /compute/v2.1/servers/3c97655f-b4c4-4378-ada2-dac458762af0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:25.652485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a83e4cb8-adf2-42d3-b152-7fb87b896f2f"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:25.654825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:25.668455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.668455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.668455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.668455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.888399 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:46:25.888867 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image limits 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:46:25.889450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Flavor pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:46:25.889862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Image pref 0:0:0 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:46:25.890282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.virt.hardware [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124772) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:46:25.899610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.900065 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.900874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:25.901350 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:25.918388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:46:25.922775 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.quota [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Getting quotas for user f9360a76354e4ae99668fe8debe4e7fb and project 10f1fba5db2b4402b2fe8d12d099e331. Resources: {'cores', 'ram', 'instances'} {{(pid=124772) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:46:25.981540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Going to run 1 instances... {{(pid=124772) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:46:25.983883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9362e96d-73cc-4844-bfaa-8b257fa3dae1',volume_size=None,volume_type=None)] {{(pid=124772) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:46:26.480283 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-622ef237-51ec-4561-a9ab-9a7250ede112 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.117718 Jul 29 14:46:26.481335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 515/1041] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:46:25 2022] POST /compute/v2.1/servers => generated 404 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:46:26.491637 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4f19d843-cf39-4c95-99d0-e18df6bc7c65 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:26.492389 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4f19d843-cf39-4c95-99d0-e18df6bc7c65 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:26.500809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-84d8146d-52d3-4b6a-8375-1a470ba90e4a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "POST /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851921 Jul 29 14:46:26.503809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 527/1042] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:46:25 2022] POST /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:26.555724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4f19d843-cf39-4c95-99d0-e18df6bc7c65 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:26.569469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4f19d843-cf39-4c95-99d0-e18df6bc7c65 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1094 microversion: 2.1 time: 0.075302 Jul 29 14:46:26.569469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 516/1043] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:26 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:26.898733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:26.899330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:26.906222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:26.906674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:26.907662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:26.908108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:26.922994 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac HTTP/1.1 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:26.924713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.926373 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '3bd0a632-5ab1-4f92-8793-e25143d73dac'} Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:26.930427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.931855 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.934985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:26.934985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2ba4aec2-efb9-4273-8d0e-89d5daab68e0 tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 404 len: 111 microversion: 2.1 time: 0.032864 Jul 29 14:46:26.934985 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 528/1044] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:26 2022] DELETE /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:26.936921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:26.937574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] [instance: 3bd0a632-5ab1-4f92-8793-e25143d73dac] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:26.943905 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:26.944353 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:26.945156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:26.945597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:26.959537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] HTTP exception thrown: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Request method failure captured: Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac HTTP/1.1 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BIBXtmeoYmnRIE8iG4fCZOhKyNERZ-rBOC4ACXXSC2fCWvOWAcgC8qLGqT2A30iY-KLqyGSUyyFKb_98JkggsGfiuBWI8oN5sjQLaVFx-w_BjFc29OfrY8vs7wh5xGMfnSE8n_aOWLLzS_MlWvywzYccyBAIF3lmsnlQaiBg_V_jA Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:26.961249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/44c869dc06224bf49f25fcf7aeb0e5a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/44c869dc06224bf49f25fcf7aeb0e5a7"}]}] Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 44c869dc06224bf49f25fcf7aeb0e5a7 Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1746083938 Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f3a38dc21bc34164aea48065da64823f Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeTestJSON-1746083938-project Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.962802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '3bd0a632-5ab1-4f92-8793-e25143d73dac'} Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:26.963992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. Jul 29 14:46:26.965474 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:26.966953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] Returning 404 to user: Instance 3bd0a632-5ab1-4f92-8793-e25143d73dac could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:26.966953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6a21ad3c-1ddf-4280-9b48-3f6548bf07ab tempest-AttachVolumeTestJSON-1746083938 tempest-AttachVolumeTestJSON-1746083938-project] 10.222.0.49 "GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac" status: 404 len: 111 microversion: 2.1 time: 0.031268 Jul 29 14:46:26.966953 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 517/1045] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:26 2022] GET /compute/v2.1/servers/3bd0a632-5ab1-4f92-8793-e25143d73dac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:27.587756 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:27.588421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:27.595660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:27.596106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:27.598697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:27.599151 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:27.683817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:27.692465 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2f1d2c0c-99b8-4ff3-b58b-7602b70e0cae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1144 microversion: 2.1 time: 0.112400 Jul 29 14:46:27.694850 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 529/1046] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:27 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1144 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:28.715524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:28.716810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:28.724696 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:28.725554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:28.726817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:28.727455 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:28.801922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:28.812452 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-eb67712d-37c0-4f29-85cd-c126237c4dcd tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1200 microversion: 2.1 time: 0.102004 Jul 29 14:46:28.813215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 518/1047] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:28 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1200 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:29.835325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:29.835940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:29.842536 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:29.842992 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:29.843769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:29.844213 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:30.090369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:30.100446 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-25c66dbd-9225-46cc-b4a6-a2297ed72136 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.269863 Jul 29 14:46:30.101459 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 530/1048] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:29 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:31.073241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-3cbfe892-7728-4838-adf2-8e74c161469b req-32826115-4915-46e6-b754-a5c53f53c9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:31.084549 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3cbfe892-7728-4838-adf2-8e74c161469b req-32826115-4915-46e6-b754-a5c53f53c9b3 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:31.085117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3cbfe892-7728-4838-adf2-8e74c161469b req-32826115-4915-46e6-b754-a5c53f53c9b3 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:31.098523 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-3cbfe892-7728-4838-adf2-8e74c161469b req-32826115-4915-46e6-b754-a5c53f53c9b3 service nova] Creating event network-changed:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:46:31.104442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-3cbfe892-7728-4838-adf2-8e74c161469b req-32826115-4915-46e6-b754-a5c53f53c9b3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034804 Jul 29 14:46:31.105945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 519/1049] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:46:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:31.126215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:31.130095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:31.134230 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:31.134697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:31.135563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:31.136042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:31.366691 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:31.374595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1667c543-41ea-4844-a47b-30cbf1b7bec2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.252484 Jul 29 14:46:31.375993 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 531/1050] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:31 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:32.402339 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:32.403072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:32.410391 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:32.442858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:32.442858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:32.442858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:32.547381 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:32.555708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4ee0cfc0-7af1-4dc4-bdae-0d8f4fd57f95 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.159046 Jul 29 14:46:32.556249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 520/1051] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:32 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:33.005095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc012c06-d4cb-4160-8bcd-1835bd6a0328 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Action: 'create', calling method: .version_select at 0x7f68100f2040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1818750000"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:33.575900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:33.576565 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:33.584548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:33.585089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:33.588029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:33.588029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:33.615099 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dc012c06-d4cb-4160-8bcd-1835bd6a0328 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.726007 Jul 29 14:46:33.615735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 532/1052] 10.222.0.49 () {60 vars in 1155 bytes} [Fri Jul 29 14:46:32 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 727 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 29 14:46:33.627590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-50bc26ff-ee27-48d4-8bc5-4f05052b12e8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f6810253430>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:33.676378 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-50bc26ff-ee27-48d4-8bc5-4f05052b12e8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 200 len: 345 microversion: 2.1 time: 0.052323 Jul 29 14:46:33.681335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 533/1053] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:46:33 2022] GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:33.724297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:33.731841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-46d5fcf9-43e7-491c-9ba7-646dcb63ba80 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.159928 Jul 29 14:46:33.732403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 521/1054] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:33 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:34.690022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-86b0ed72-b6fb-4f8b-b700-d406e6e79a41 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f6810253af0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:34.737740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-86b0ed72-b6fb-4f8b-b700-d406e6e79a41 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 200 len: 346 microversion: 2.1 time: 0.051409 Jul 29 14:46:34.738393 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 534/1055] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:46:34 2022] GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:34.752656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:34.753998 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:34.755865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c6446d44-21a2-4a1e-92b9-ac26988e7c61 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Action: 'create', calling method: .version_select at 0x7f681031fc10>, body: {"snapshot": {"volume_id": "7682ede7-3d51-4e07-842a-211e6654bfeb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-449237018"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:34.760426 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:34.760871 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:34.761795 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:34.762231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:34.899726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:34.907139 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8f60c750-2c8a-49da-9ecb-4b080c5a501f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.158495 Jul 29 14:46:34.907707 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 522/1056] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:34 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:35.233774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c6446d44-21a2-4a1e-92b9-ac26988e7c61 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.482210 Jul 29 14:46:35.236438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 535/1057] 10.222.0.49 () {60 vars in 1162 bytes} [Fri Jul 29 14:46:34 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:35.245701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7f299f43-b9a1-445d-8f56-ae8a280b6de8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f6810206820>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.297194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7f299f43-b9a1-445d-8f56-ae8a280b6de8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.055234 Jul 29 14:46:35.297763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 523/1058] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:35 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:35.309057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5c9b2904-6d77-48e4-a9f5-1b6ea0ac3d14 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68100f2430>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.365784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5c9b2904-6d77-48e4-a9f5-1b6ea0ac3d14 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.060530 Jul 29 14:46:35.372345 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 536/1059] 10.222.0.49 () {58 vars in 1140 bytes} [Fri Jul 29 14:46:35 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:35.377689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8eaa78f9-d350-4e7d-bd33-4a32bf1a8c20 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68100afaf0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.429573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8eaa78f9-d350-4e7d-bd33-4a32bf1a8c20 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.055834 Jul 29 14:46:35.430147 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 524/1060] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:35 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:35.476701 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.479535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:35.483973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.484428 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:35.485232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.485688 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:35.565826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'services' on Instance uuid 87d41dbf-6b3c-4c81-872f-424cb32c445b {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:46:35.827633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ca61dd73-dcd3-4b03-aa8b-3cb5e086495a tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments/a83e4cb8-adf2-42d3-b152-7fb87b896f2f" status: 202 len: 0 microversion: 2.1 time: 0.354717 Jul 29 14:46:35.828340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 537/1061] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:46:35 2022] DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments/a83e4cb8-adf2-42d3-b152-7fb87b896f2f => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:46:35.837286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.839443 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:35.846076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.846527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:35.847304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.847739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:35.881438 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c70c3efd-579c-45fb-a565-acb77b6a8373 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048648 Jul 29 14:46:35.882103 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 525/1062] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:35 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:35.929150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:35.929852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:35.936212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.936671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:35.937469 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:35.937905 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:36.075148 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:36.088910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-926ebafa-6058-4c11-a71b-659041e404ae tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1276 microversion: 2.1 time: 0.158515 Jul 29 14:46:36.088910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 538/1063] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:35 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:36.441779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3f5d211c-ae3a-4caf-b6ac-8f41cf4eb9ca tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68101f08b0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:36.447721 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:36.470833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3f5d211c-ae3a-4caf-b6ac-8f41cf4eb9ca tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.032853 Jul 29 14:46:36.471415 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 526/1064] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:36 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:36.894098 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:36.897254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:36.903976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:36.904422 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:36.905225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:36.905689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:36.935617 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-12c48743-7e7c-4308-9a8c-b096e4486e60 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Jul 29 14:46:36.936176 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 539/1065] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:36 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:37.101657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=8 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:37.106163 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:37.106809 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:37.113187 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:37.113644 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:37.114425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:37.114869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:37.245828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:37.253221 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9c150be1-a310-4cf2-956d-e381edb7b7a4 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.152321 Jul 29 14:46:37.253770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 527/1066] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:37 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:37.483924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-14a5f2c2-26e6-4009-b8a0-f69bd98d7318 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68102b3ca0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:37.514051 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-14a5f2c2-26e6-4009-b8a0-f69bd98d7318 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.033926 Jul 29 14:46:37.514605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 540/1067] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:37 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:37.947915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:37.950170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:37.956425 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:37.956881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:37.957728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:37.958170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:37.986872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9e8886a4-3c20-40e3-a587-e11f8b40229f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042921 Jul 29 14:46:37.987407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 528/1068] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:37 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:38.275419 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:38.276035 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:38.282162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:38.283709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:38.283709 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:38.283987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:38.412448 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:38.419952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd13fbc1-4762-46d0-9d25-056f975cad93 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.149703 Jul 29 14:46:38.420524 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 541/1069] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:38 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:38.527035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9f2c47e5-7083-41af-93d1-e240c3fa0329 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f681048a9d0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:38.557449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9f2c47e5-7083-41af-93d1-e240c3fa0329 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.034054 Jul 29 14:46:38.558034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 529/1070] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:38 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:38.999928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:39.002118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:39.008839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:39.009306 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:39.010076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:39.010514 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:39.038566 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d3858a11-3ee8-402e-b541-fac59b7a0597 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042713 Jul 29 14:46:39.045504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 542/1071] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:38 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:39.440621 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:39.441269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:39.447564 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:39.448016 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:39.448787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:39.449253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:39.570172 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5b0c5ecc-8c54-45ac-991b-fdbe19c2baa2 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f681012c1f0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:39.587385 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:39.594939 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a56d4ddb-d2db-49cb-87af-69194c5d73c0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.158208 Jul 29 14:46:39.595504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 530/1072] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:39 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:39.603667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5b0c5ecc-8c54-45ac-991b-fdbe19c2baa2 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.037242 Jul 29 14:46:39.604256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 543/1073] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:39 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:40.051215 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:40.053547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:40.059576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:40.063402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:40.063402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:40.063402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:40.090704 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bf840a88-e3fa-49fb-b091-57e6a44a1bb1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Jul 29 14:46:40.091256 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 531/1074] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:40 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:40.616745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:40.617458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a11c2867-8ca7-4438-b458-6adde434ecb7 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68102b3ca0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:40.617829 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:40.623939 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:40.624388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:40.625184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:40.625620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:40.647243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a11c2867-8ca7-4438-b458-6adde434ecb7 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 287 microversion: 2.1 time: 0.035413 Jul 29 14:46:40.647941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 544/1075] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:40 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:40.658642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e86f80be-e2c2-49e0-b045-058f79270cb4 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68100b38b0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:40.764004 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:40.768487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1e1cc99a-72f2-4bb4-b4ab-5aa082f304d8 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.156193 Jul 29 14:46:40.771520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 532/1076] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:40 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:40.798640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e86f80be-e2c2-49e0-b045-058f79270cb4 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 202 len: 0 microversion: 2.1 time: 0.143531 Jul 29 14:46:40.799212 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 545/1077] 10.222.0.49 () {58 vars in 1254 bytes} [Fri Jul 29 14:46:40 2022] DELETE /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 14:46:40.808519 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-05b0ad4d-ec06-4ac9-a8fd-0dc58afabefd tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68101f05e0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:40.837900 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-05b0ad4d-ec06-4ac9-a8fd-0dc58afabefd tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 200 len: 286 microversion: 2.1 time: 0.033518 Jul 29 14:46:40.838464 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 533/1078] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:40 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:41.103809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:41.106048 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:41.112174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:41.112619 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:41.113417 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:41.114363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:41.146737 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e06aa98b-3302-4df7-baa7-a10816be25a1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046831 Jul 29 14:46:41.147399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 546/1079] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:41 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:41.790642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:41.791375 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:41.797609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:41.798050 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:41.798806 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:41.799237 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:41.850950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e2fab4a-4f5c-4734-bb22-530e1277c9b9 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f681011df70>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:41.878272 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-9e2fab4a-4f5c-4734-bb22-530e1277c9b9 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] HTTP exception thrown: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e2fab4a-4f5c-4734-bb22-530e1277c9b9 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Request method failure captured: Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 HTTP/1.1 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_LIiBS3YkEmN7qUFWIYC1GOmuOgZJmlpILmdPjpkLrYBLOyaCJ-NsS_yVRN3PdNWMH5-Aklaj-uztWl32w1w-FRxEFsiV_yWiV1dWpYMRzEv1SlbS_1H6FljioGgD-RLbJ3U-dsLQ4I0bBPzj542Giwj2ZyZBgTiNKK63G0qiy8RMA Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:41.880607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97a611dec40d40bdbc0c21e2223793e5"}]}] Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 7687d5ac872449efb74266fe41dfb9eb Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '9529ff0d-aacc-4689-8a71-b831bd2732d9'} Jul 29 14:46:41.882170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. (HTTP 404) (Request-ID: req-5387a6b9-dd46-4160-b126-4156361f0b62) Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.883084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:41.884254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 29 14:46:41.885454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. Jul 29 14:46:41.886718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:41.888450 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9e2fab4a-4f5c-4734-bb22-530e1277c9b9 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Returning 404 to user: Snapshot 9529ff0d-aacc-4689-8a71-b831bd2732d9 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:41.889331 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9e2fab4a-4f5c-4734-bb22-530e1277c9b9 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9" status: 404 len: 111 microversion: 2.1 time: 0.042892 Jul 29 14:46:41.889926 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 547/1080] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:46:41 2022] GET /compute/v2.1/os-snapshots/9529ff0d-aacc-4689-8a71-b831bd2732d9 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:46:41.898803 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-434bf6b7-361a-45fb-ab18-5f5274efec94 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68100fe550>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:41.940559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:41.948716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-74cf7c10-19cf-425c-8132-f9170ed004f3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.162999 Jul 29 14:46:41.949345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 534/1081] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:41 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:42.086097 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-434bf6b7-361a-45fb-ab18-5f5274efec94 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 202 len: 0 microversion: 2.1 time: 0.191860 Jul 29 14:46:42.088482 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 548/1082] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:46:41 2022] DELETE /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 29 14:46:42.095295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2991c3fd-cd7b-481c-920e-6ba9e690817a tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68101f0040>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:42.144358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2991c3fd-cd7b-481c-920e-6ba9e690817a tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 200 len: 345 microversion: 2.1 time: 0.053308 Jul 29 14:46:42.144949 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 535/1083] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:46:42 2022] GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:42.158302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:42.161090 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:42.167396 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:42.167852 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:42.168640 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:42.169111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:42.199486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7cb1ee46-9786-4b83-a6c2-c28204bd7ab1 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Jul 29 14:46:42.200388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 549/1084] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:42 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:42.970388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:42.970937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:42.977233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:42.977685 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:42.978451 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:42.978891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.114543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:43.121895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-30c314d1-8a49-4005-ab08-c6bda9b1711e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.156197 Jul 29 14:46:43.122449 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 536/1085] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:42 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:43.158550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-91cb6129-46ed-490d-a02b-d91527470690 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f681031f3a0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.187921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-91cb6129-46ed-490d-a02b-d91527470690 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] HTTP exception thrown: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-91cb6129-46ed-490d-a02b-d91527470690 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Request method failure captured: Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb HTTP/1.1 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_LIiBS3YkEmN7qUFWIYC1GOmuOgZJmlpILmdPjpkLrYBLOyaCJ-NsS_yVRN3PdNWMH5-Aklaj-uztWl32w1w-FRxEFsiV_yWiV1dWpYMRzEv1SlbS_1H6FljioGgD-RLbJ3U-dsLQ4I0bBPzj542Giwj2ZyZBgTiNKK63G0qiy8RMA Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:43.189899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97a611dec40d40bdbc0c21e2223793e5"}]}] Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 7687d5ac872449efb74266fe41dfb9eb Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '7682ede7-3d51-4e07-842a-211e6654bfeb'} Jul 29 14:46:43.191495 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. (HTTP 404) (Request-ID: req-989d85df-a594-4cba-ae88-899efb485e0c) Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.193132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:43.194572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 14:46:43.195948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-91cb6129-46ed-490d-a02b-d91527470690 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Returning 404 to user: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-91cb6129-46ed-490d-a02b-d91527470690 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 404 len: 109 microversion: 2.1 time: 0.036713 Jul 29 14:46:43.197464 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 550/1086] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:46:43 2022] GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:43.205967 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d3e577d5-2e77-42b1-9f23-629f059040f8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68102140d0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.211706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.214865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:43.221083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.221483 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.222260 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.222703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.234233 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-d3e577d5-2e77-42b1-9f23-629f059040f8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] HTTP exception thrown: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d3e577d5-2e77-42b1-9f23-629f059040f8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Request method failure captured: Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb HTTP/1.1 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_LIiBS3YkEmN7qUFWIYC1GOmuOgZJmlpILmdPjpkLrYBLOyaCJ-NsS_yVRN3PdNWMH5-Aklaj-uztWl32w1w-FRxEFsiV_yWiV1dWpYMRzEv1SlbS_1H6FljioGgD-RLbJ3U-dsLQ4I0bBPzj542Giwj2ZyZBgTiNKK63G0qiy8RMA Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:43.236294 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97a611dec40d40bdbc0c21e2223793e5"}]}] Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 7687d5ac872449efb74266fe41dfb9eb Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '7682ede7-3d51-4e07-842a-211e6654bfeb'} Jul 29 14:46:43.237870 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. (HTTP 404) (Request-ID: req-b7cf9534-2460-4b23-9cee-6cd6e6aba249) Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.239624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 29 14:46:43.241079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 29 14:46:43.242465 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d3e577d5-2e77-42b1-9f23-629f059040f8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Returning 404 to user: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d3e577d5-2e77-42b1-9f23-629f059040f8 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 404 len: 109 microversion: 2.1 time: 0.035584 Jul 29 14:46:43.243851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 537/1087] 10.222.0.49 () {58 vars in 1248 bytes} [Fri Jul 29 14:46:43 2022] DELETE /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:43.246656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-de92bb03-a413-4cb5-9597-1fa51e4f0112 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Calling method '.version_select at 0x7f68102723a0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.252931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef3dc1cb-0dd9-4edd-a738-a314414468e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045297 Jul 29 14:46:43.253520 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 551/1088] 10.222.0.49 () {58 vars in 1302 bytes} [Fri Jul 29 14:46:43 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 29 14:46:43.276003 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-de92bb03-a413-4cb5-9597-1fa51e4f0112 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] HTTP exception thrown: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-de92bb03-a413-4cb5-9597-1fa51e4f0112 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Request method failure captured: Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb HTTP/1.1 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_LIiBS3YkEmN7qUFWIYC1GOmuOgZJmlpILmdPjpkLrYBLOyaCJ-NsS_yVRN3PdNWMH5-Aklaj-uztWl32w1w-FRxEFsiV_yWiV1dWpYMRzEv1SlbS_1H6FljioGgD-RLbJ3U-dsLQ4I0bBPzj542Giwj2ZyZBgTiNKK63G0qiy8RMA Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:43.278183 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/97a611dec40d40bdbc0c21e2223793e5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/97a611dec40d40bdbc0c21e2223793e5"}]}] Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 97a611dec40d40bdbc0c21e2223793e5 Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-297320247 Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 7687d5ac872449efb74266fe41dfb9eb Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesSnapshotsTestJSON-297320247-project Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '7682ede7-3d51-4e07-842a-211e6654bfeb'} Jul 29 14:46:43.279869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. (HTTP 404) (Request-ID: req-f25dd5c9-456f-417f-af16-543d9d337a37) Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.281066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 29 14:46:43.282559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 29 14:46:43.284128 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-de92bb03-a413-4cb5-9597-1fa51e4f0112 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] Returning 404 to user: Volume 7682ede7-3d51-4e07-842a-211e6654bfeb could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-de92bb03-a413-4cb5-9597-1fa51e4f0112 tempest-VolumesSnapshotsTestJSON-297320247 tempest-VolumesSnapshotsTestJSON-297320247-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb" status: 404 len: 109 microversion: 2.1 time: 0.038091 Jul 29 14:46:43.286152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 538/1089] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:46:43 2022] GET /compute/v2.1/os-volumes/7682ede7-3d51-4e07-842a-211e6654bfeb => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:43.319809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.320311 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:43.326307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.326762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.327535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.327974 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.353327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:46:43.367126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:43.674044 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-12531bb8-bf7d-4d01-b244-b7c3eb1d4c50 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 204 len: 0 microversion: 2.1 time: 0.358032 Jul 29 14:46:43.674869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 552/1090] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:43 2022] DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:46:43.683641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:43.684258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:43.690353 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.690809 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.691585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:43.692076 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:43.838573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:43.846146 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-76f45995-c765-45bb-974f-d78587eaef87 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1681 microversion: 2.1 time: 0.166456 Jul 29 14:46:43.846711 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 539/1091] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:43 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:44.142927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:44.143622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:44.150501 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:44.150956 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:44.151730 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:44.152162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:44.288554 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:44.296333 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5dda5d17-95ac-4bce-8942-d14df92a3be5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.157435 Jul 29 14:46:44.296892 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 553/1092] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:44 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:44.867360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:44.868084 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:44.874903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:44.880052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:44.880052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:44.880052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:45.014864 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:45.022442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3ee0f148-a3f5-4b7e-8cec-3ad7341925b7 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1681 microversion: 2.1 time: 0.159432 Jul 29 14:46:45.023044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 540/1093] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:44 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:45.316792 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:45.320225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:45.324285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:45.324734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:45.325547 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:45.325983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:45.462636 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:45.470009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-09a6dd16-473c-4677-89f7-3eff9588e76b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.157117 Jul 29 14:46:45.470560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 554/1094] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:45 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:46.043896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:46.044546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:46.051022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:46.051516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:46.052956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:46.053606 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:46.199688 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:46.207262 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a1376900-5b18-489c-8696-24b43ee769f0 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1681 microversion: 2.1 time: 0.167354 Jul 29 14:46:46.207821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 541/1095] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:46 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:46.491119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:46.491866 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:46.498551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:46.499104 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:46.499961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:46.500490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:46.735277 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:46.743937 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0a86e10b-b6bd-41c7-a658-5a7d29b7296d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.257310 Jul 29 14:46:46.744890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 555/1096] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:46 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:47.230344 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:47.231364 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:47.239124 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:47.239718 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:47.241154 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:47.241597 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:47.261322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:47.319413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:47.327298 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6c5ee383-0e0a-49b8-a0f2-a4fdf81c9d0d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1613 microversion: 2.1 time: 0.101323 Jul 29 14:46:47.328054 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 542/1097] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:47 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1613 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:47.577907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-005c2f68-a681-4558-8acd-3fe792713dd3 req-8dba4e7b-0385-4002-b9ee-8df3df016804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87d41dbf-6b3c-4c81-872f-424cb32c445b", "name": "network-vif-deleted", "tag": "19ddc3be-17e4-445f-81f6-48955f909d0b"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:47.592535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-005c2f68-a681-4558-8acd-3fe792713dd3 req-8dba4e7b-0385-4002-b9ee-8df3df016804 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:47.593122 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-005c2f68-a681-4558-8acd-3fe792713dd3 req-8dba4e7b-0385-4002-b9ee-8df3df016804 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:47.605148 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-005c2f68-a681-4558-8acd-3fe792713dd3 req-8dba4e7b-0385-4002-b9ee-8df3df016804 service nova] Creating event network-vif-deleted:19ddc3be-17e4-445f-81f6-48955f909d0b for instance 87d41dbf-6b3c-4c81-872f-424cb32c445b on hv-cinder-79987 Jul 29 14:46:47.610315 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-005c2f68-a681-4558-8acd-3fe792713dd3 req-8dba4e7b-0385-4002-b9ee-8df3df016804 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036000 Jul 29 14:46:47.614095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 556/1098] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:46:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:46:47.766400 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:47.767193 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:47.774609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:47.775060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:47.775838 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:47.776504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:47.919486 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:47.925638 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8f126366-07ef-4626-a19f-9e208d45116d tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.163544 Jul 29 14:46:47.926210 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 543/1099] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:47 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:48.350324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:48.351266 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:48.359121 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:48.359572 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:48.360346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:48.360779 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:48.392579 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:48.393042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:48.393710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lazy-loading 'fault' on Instance uuid 87d41dbf-6b3c-4c81-872f-424cb32c445b {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:46:48.441034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30432a068ad8486db8af635e66776f90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1776579056dd420d81368ec51e2ddb95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:48.449352 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a467d8d0-abd1-4694-9dfa-f79e3cb31f09 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 200 len: 1331 microversion: 2.1 time: 0.104282 Jul 29 14:46:48.449948 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 557/1100] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:48 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 1331 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:48.947279 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:48.947907 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:48.954500 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:48.954946 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:48.955705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:48.956140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:49.093025 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:49.100573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9b16cad5-1602-4aa9-99e0-0438383a124a tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.157148 Jul 29 14:46:49.101184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 544/1101] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:48 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:49.471851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:49.472607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:49.480083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:49.480533 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:49.481339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:49.481778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:49.496746 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b HTTP/1.1 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:49.498712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:49.500116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '87d41dbf-6b3c-4c81-872f-424cb32c445b'} Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:49.501065 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:49.502697 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:49.504083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:49.504083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-64242885-00da-434d-bc73-de7a17a41d3d tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 404 len: 111 microversion: 2.1 time: 0.032293 Jul 29 14:46:49.504083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 558/1102] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:49 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:49.509699 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-85748566-4931-4401-8720-84b02eaace24 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '.version_select at 0x7f68102cddc0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:49.598377 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-85748566-4931-4401-8720-84b02eaace24 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289384343" status: 202 len: 0 microversion: 2.1 time: 0.092343 Jul 29 14:46:49.598874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 545/1103] 10.222.0.49 () {58 vars in 1218 bytes} [Fri Jul 29 14:46:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289384343 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:46:50.121716 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:50.122605 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:50.129141 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:50.129594 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:50.130434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:50.131661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:50.264156 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:50.272430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-52b8f71d-2cc4-4b15-b3a8-094b62f70f96 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.155001 Jul 29 14:46:50.273127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 559/1104] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:50 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:51.296306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:51.296944 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:51.307550 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.308021 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.309810 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.310264 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.449142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-6b3db44f-fb64-4d0d-90f4-6537fd3e222b req-30f05cf4-9da1-46a3-a424-5fa40ef2d87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "name": "network-vif-plugged", "status": "completed", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:46:51.459623 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6b3db44f-fb64-4d0d-90f4-6537fd3e222b req-30f05cf4-9da1-46a3-a424-5fa40ef2d87f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.460094 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-6b3db44f-fb64-4d0d-90f4-6537fd3e222b req-30f05cf4-9da1-46a3-a424-5fa40ef2d87f service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.464985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:51.471261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-6b3db44f-fb64-4d0d-90f4-6537fd3e222b req-30f05cf4-9da1-46a3-a424-5fa40ef2d87f service nova] Creating event network-vif-plugged:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:46:51.472388 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3179de19-1324-49bd-92bc-437926c05adf tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.181494 Jul 29 14:46:51.473497 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 546/1105] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:51 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:51.476131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-6b3db44f-fb64-4d0d-90f4-6537fd3e222b req-30f05cf4-9da1-46a3-a424-5fa40ef2d87f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031444 Jul 29 14:46:51.476733 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 560/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:46:51.648186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:51.648705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:51.654657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.655108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.655872 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.656309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.669678 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b HTTP/1.1 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:51.671410 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.673014 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '87d41dbf-6b3c-4c81-872f-424cb32c445b'} Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:51.673821 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.675008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.676258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:51.676258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-49fc5401-1630-4664-ad62-3d58a4aca563 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 404 len: 111 microversion: 2.1 time: 0.028446 Jul 29 14:46:51.676258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 547/1107] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:51 2022] DELETE /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:51.682689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:51.683415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 87d41dbf-6b3c-4c81-872f-424cb32c445b] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:51.689595 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.690050 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.690826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:51.691269 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:51.704695 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b HTTP/1.1 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:46:51.706327 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.707901 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '87d41dbf-6b3c-4c81-872f-424cb32c445b'} Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:51.709415 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. Jul 29 14:46:51.710922 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:46:51.712274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 87d41dbf-6b3c-4c81-872f-424cb32c445b could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:51.712274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-35401b4b-fd39-4e26-a364-d40522cfc785 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b" status: 404 len: 111 microversion: 2.1 time: 0.029907 Jul 29 14:46:51.712274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 561/1108] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:51 2022] GET /compute/v2.1/servers/87d41dbf-6b3c-4c81-872f-424cb32c445b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:52.492503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:52.493070 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:52.499660 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:52.500179 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:52.500960 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:52.501423 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:52.631175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:52.638679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c94409fd-8d41-4bd0-8dfe-88a63c3a63ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.150329 Jul 29 14:46:52.639248 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 548/1109] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:52 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:53.659128 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:53.659740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:53.667409 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:53.667856 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:53.668611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:53.669070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:53.802807 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:53.810259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-925d3157-fe93-4bd8-b469-e81d4c3f72ac tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.154955 Jul 29 14:46:53.810820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 562/1110] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:53 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:54.831041 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:54.831647 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:54.838300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:54.838747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:54.839507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:54.839940 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:54.973661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:54.981756 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b58812ff-f54d-4979-9246-792f804f6320 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.154529 Jul 29 14:46:54.982327 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 549/1111] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:54 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:56.002114 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:56.002720 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:56.005225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:56.010983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:56.011431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:56.012195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:56.012624 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:56.146848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:56.154390 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d3f63bfe-f85e-42de-a390-59d86bafdbd0 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.156069 Jul 29 14:46:56.154962 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 563/1112] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:55 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:57.170446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:57.174865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:57.174865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:46:57.175066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:57.175066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:57.179203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.179856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.180728 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.181281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.182429 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.182936 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.183648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.184217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.195856 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d HTTP/1.1 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:57.197576 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.199078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '2e6d02d4-eb24-41e9-b261-4ba55250bf1d'} Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:57.199884 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.201334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.202674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:57.202674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c1acedcb-cf42-4628-8daa-6f5001ccac65 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 404 len: 111 microversion: 2.1 time: 0.032521 Jul 29 14:46:57.202674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 550/1113] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:57 2022] DELETE /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:57.207435 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:57.208045 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 2e6d02d4-eb24-41e9-b261-4ba55250bf1d] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:57.214513 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.214990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.215764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.216201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.230729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d HTTP/1.1 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:57.232359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.234083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '2e6d02d4-eb24-41e9-b261-4ba55250bf1d'} Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:57.235166 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. Jul 29 14:46:57.236719 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.238304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 2e6d02d4-eb24-41e9-b261-4ba55250bf1d could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:57.238304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-86eb64f9-01ea-4b10-9d7c-11d5ad91c027 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d" status: 404 len: 111 microversion: 2.1 time: 0.029929 Jul 29 14:46:57.238304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 551/1114] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:57 2022] GET /compute/v2.1/servers/2e6d02d4-eb24-41e9-b261-4ba55250bf1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:57.243175 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:57.243676 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:57.250642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.251096 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.251881 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.252320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.267378 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad HTTP/1.1 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:57.269071 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.270588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'e1b03f71-e979-45c1-a50f-40bbb4ef2bad'} Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:57.272144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.278653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.280737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:57.280737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-34c37d89-d340-42e6-ac8c-a471acf41989 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 404 len: 111 microversion: 2.1 time: 0.031816 Jul 29 14:46:57.280737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 552/1115] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:46:57 2022] DELETE /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:57.280737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:57.280737 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: e1b03f71-e979-45c1-a50f-40bbb4ef2bad] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:57.286575 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.287617 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.288537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:57.288977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:57.304199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad HTTP/1.1 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:46:57.306227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.307894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'e1b03f71-e979-45c1-a50f-40bbb4ef2bad'} Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:46:57.308811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. Jul 29 14:46:57.310284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:46:57.311547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance e1b03f71-e979-45c1-a50f-40bbb4ef2bad could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:46:57.311547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3011be62-24ef-479f-b256-a4a08969859f tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad" status: 404 len: 111 microversion: 2.1 time: 0.032369 Jul 29 14:46:57.311935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 553/1116] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:57 2022] GET /compute/v2.1/servers/e1b03f71-e979-45c1-a50f-40bbb4ef2bad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:46:57.337716 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:57.347970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6180aff2-5c8c-42bf-bb46-25e7dc134cf3 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1264 microversion: 2.1 time: 0.177382 Jul 29 14:46:57.348579 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 564/1117] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:57 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:46:58.370553 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:58.371158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:58.377678 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:58.378123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:58.378882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:58.379314 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:58.510847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:58.518352 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3e403b4c-15d7-43ba-82fb-e4ec058f62d5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1452 microversion: 2.1 time: 0.152730 Jul 29 14:46:58.518909 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 554/1118] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:58 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:46:58.538577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:46:58.539190 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:46:58.545996 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:58.546462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:58.547237 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:46:58.547687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:46:58.677654 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:46:58.685735 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aab6f77b-5fc0-4bac-a76b-363f606abbf5 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1452 microversion: 2.1 time: 0.151047 Jul 29 14:46:58.686304 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 565/1119] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:46:58 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:00.682229 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-e1b17f89-b4aa-4bea-88c0-6d5004619a38 req-f0c781b9-733a-4852-abc0-c72c2a4c72ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:47:00.692860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e1b17f89-b4aa-4bea-88c0-6d5004619a38 req-f0c781b9-733a-4852-abc0-c72c2a4c72ff service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:00.692860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e1b17f89-b4aa-4bea-88c0-6d5004619a38 req-f0c781b9-733a-4852-abc0-c72c2a4c72ff service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:00.704495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-e1b17f89-b4aa-4bea-88c0-6d5004619a38 req-f0c781b9-733a-4852-abc0-c72c2a4c72ff service nova] Creating event network-changed:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:47:00.709883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-e1b17f89-b4aa-4bea-88c0-6d5004619a38 req-f0c781b9-733a-4852-abc0-c72c2a4c72ff service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Jul 29 14:47:00.710641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 555/1120] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:03.878037 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:03.878587 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:03.885905 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:03.886360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:03.887134 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:03.887573 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:03.900542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae HTTP/1.1 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:47:03.902116 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.906804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae'} Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:03.907580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.908869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.910170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:03.910170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d45923ce-ba8d-4e95-9c64-501b4da35a99 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 404 len: 111 microversion: 2.1 time: 0.029337 Jul 29 14:47:03.910170 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 566/1121] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:47:03 2022] DELETE /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:47:03.913620 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:03.914354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] [instance: 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:03.920534 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:03.921275 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:03.922038 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:03.922477 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:03.936356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] HTTP exception thrown: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Request method failure captured: Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae HTTP/1.1 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_BB9l08pGS8gvujKnoB8eMAY4gtnRdeEn8Q7piknz_LcF9UYs2lFVWvf3q1x5AgYhNOMBei7ZP7-g9wJPITKNCgpku_WuNywTvk8JU_yQa5Kk-gd_C16irWOi5QRUPB73vyaCzzRFJh9dqk5x1kdSgkApXc78obWjOlFibRgrj6Ed4 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:47:03.938007 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_1776579056dd420d81368ec51e2ddb95"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/1776579056dd420d81368ec51e2ddb95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/1776579056dd420d81368ec51e2ddb95"}]}] Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 1776579056dd420d81368ec51e2ddb95 Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1090098093 Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 30432a068ad8486db8af635e66776f90 Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeNegativeTest-1090098093-project Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.939587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae'} Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:03.940446 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. Jul 29 14:47:03.941788 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:03.942951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] Returning 404 to user: Instance 6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:03.942951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-aa98d2dd-5fd9-4834-b700-c435bd0907e6 tempest-AttachVolumeNegativeTest-1090098093 tempest-AttachVolumeNegativeTest-1090098093-project] 10.222.0.49 "GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae" status: 404 len: 111 microversion: 2.1 time: 0.031071 Jul 29 14:47:03.942951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 556/1122] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:47:03 2022] GET /compute/v2.1/servers/6e3d9b02-1c1e-4b44-ac4a-758116d5c0ae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:47:14.353487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:14.355682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:14.357940 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=7 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:47:14.358719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:47:14.363375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.363826 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.364678 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.365221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.394351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6a7c86f4-441e-4cf4-8c92-3f985976a3fb tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045379 Jul 29 14:47:14.394933 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 567/1123] 10.222.0.49 () {60 vars in 1343 bytes} [Fri Jul 29 14:47:14 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:14.455745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:14.456247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:14.458896 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=13 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:47:14.460111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=52 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:47:14.464793 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.465284 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.466062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.466501 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.491664 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:47:14.759645 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2b46b90d-7934-490a-aea7-37fd5d2b31e3 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 204 len: 0 microversion: 2.20 time: 0.307378 Jul 29 14:47:14.760152 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 557/1124] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 14:47:14 2022] DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 14:47:14.768799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:14.774352 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:14.778018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.778466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.779232 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:14.779828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:14.916262 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:14.924921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:14.926456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:14.927622 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ae99007-a0b7-4b1d-9325-dd272ac102aa tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.163250 Jul 29 14:47:14.928344 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 568/1125] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:14 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:47:15.952303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:15.953022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:15.959945 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:15.960418 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:15.962831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:15.962831 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:16.096619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:16.105698 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:16.110398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:16.110398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3a43f586-0b89-4225-a27d-2ed1abbd9956 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.160436 Jul 29 14:47:16.110398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 558/1126] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:15 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:47:16.436053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-77573291-e6be-4a7b-9840-b17358c5dcc2 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f68100b3af0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:16.484343 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-77573291-e6be-4a7b-9840-b17358c5dcc2 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/8cb79482-5312-4210-9e7d-93ba18820893" status: 200 len: 350 microversion: 2.1 time: 0.052026 Jul 29 14:47:16.484918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 569/1127] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:47:16 2022] GET /compute/v2.1/os-volumes/8cb79482-5312-4210-9e7d-93ba18820893 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:17.134450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:17.135208 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:17.141861 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:17.142319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:17.143089 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:17.143520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:17.295903 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:17.304277 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:17.306078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:17.307458 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1cd33af2-68a1-4419-a2e8-ea67ba590f48 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1725 microversion: 2.20 time: 0.179752 Jul 29 14:47:17.308020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 559/1128] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:17 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:47:17.993043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-41fc0a33-3232-45f6-aa96-73e2c11fe14d req-c8ccd70f-9e5c-452f-9c8a-4863c3a4ca63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee43a21b-7169-4399-8904-ae6bf95ee322", "name": "network-vif-deleted", "tag": "52c7857d-c0ee-458e-a694-ecea5894230d"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:47:18.014273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-41fc0a33-3232-45f6-aa96-73e2c11fe14d req-c8ccd70f-9e5c-452f-9c8a-4863c3a4ca63 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:18.014719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-41fc0a33-3232-45f6-aa96-73e2c11fe14d req-c8ccd70f-9e5c-452f-9c8a-4863c3a4ca63 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:18.029736 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-41fc0a33-3232-45f6-aa96-73e2c11fe14d req-c8ccd70f-9e5c-452f-9c8a-4863c3a4ca63 service nova] Creating event network-vif-deleted:52c7857d-c0ee-458e-a694-ecea5894230d for instance ee43a21b-7169-4399-8904-ae6bf95ee322 on hv-cinder-79987 Jul 29 14:47:18.037066 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-41fc0a33-3232-45f6-aa96-73e2c11fe14d req-c8ccd70f-9e5c-452f-9c8a-4863c3a4ca63 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.189234 Jul 29 14:47:18.043106 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 570/1129] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:18.331792 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:18.332442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:18.340123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:18.340650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:18.341515 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:18.341950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:18.375369 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:18.375815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:18.376412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lazy-loading 'fault' on Instance uuid ee43a21b-7169-4399-8904-ae6bf95ee322 {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:47:18.429413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:18.429413 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:18.429731 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'de769d721b8b49c6a5d7d391412da122', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdbc49e630fc461a858eb04c2dd52a82', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:47:18.429855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-abcd0cf5-9aa4-4d47-85a9-e20975f38c52 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 200 len: 1372 microversion: 2.20 time: 0.102225 Jul 29 14:47:18.430345 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 560/1130] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:18 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 1372 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 29 14:47:19.122220 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7650d2e5-ced5-4853-9294-3599f6a9cbff tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f68102989d0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:19.175851 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7650d2e5-ced5-4853-9294-3599f6a9cbff tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/5cc3982f-e710-4463-91f1-4c38d501715a" status: 200 len: 351 microversion: 2.1 time: 0.058094 Jul 29 14:47:19.176496 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 571/1131] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:47:19 2022] GET /compute/v2.1/os-volumes/5cc3982f-e710-4463-91f1-4c38d501715a => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:19.452935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:19.453639 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:19.460965 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:19.461462 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:19.462230 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:19.462671 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:19.478303 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 HTTP/1.1 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:47:19.480126 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:19.481875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'ee43a21b-7169-4399-8904-ae6bf95ee322'} Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:19.483480 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:19.484954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:19.486526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:19.486526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c6941749-8190-4f7d-baa9-65587cb3d6f7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 404 len: 111 microversion: 2.20 time: 0.032726 Jul 29 14:47:19.486526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 561/1132] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:19 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:47:19.490364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0564ed91-95cb-4616-90ad-2e10115862bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '.version_select at 0x7f68100b3af0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:19.561340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0564ed91-95cb-4616-90ad-2e10115862bd tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804151451" status: 204 len: 0 microversion: 2.20 time: 0.074563 Jul 29 14:47:19.565259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 572/1133] 10.222.0.49 () {60 vars in 1262 bytes} [Fri Jul 29 14:47:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804151451 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 29 14:47:21.659588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:21.660104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:21.667117 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:21.667566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:21.668335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:21.668769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:21.682727 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 HTTP/1.1 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:47:21.684307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.685799 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'ee43a21b-7169-4399-8904-ae6bf95ee322'} Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:21.686539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.687729 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.688962 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:21.688962 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-d6fd4ce0-fe80-4860-90f5-f4b2d2d26267 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 404 len: 111 microversion: 2.20 time: 0.029920 Jul 29 14:47:21.688962 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 562/1134] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 14:47:21 2022] DELETE /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 14:47:21.695380 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:21.696122 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: ee43a21b-7169-4399-8904-ae6bf95ee322] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:21.702662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:21.703195 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:21.704081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:21.704772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:21.719282 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 HTTP/1.1 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:47:21.720934 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.722610 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': 'ee43a21b-7169-4399-8904-ae6bf95ee322'} Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:21.723439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. Jul 29 14:47:21.724665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:21.726824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance ee43a21b-7169-4399-8904-ae6bf95ee322 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:21.726824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f3fceca0-b586-4a43-bfe1-56ba2932da43 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322" status: 404 len: 111 microversion: 2.20 time: 0.031976 Jul 29 14:47:21.726824 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 573/1135] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:21 2022] GET /compute/v2.1/servers/ee43a21b-7169-4399-8904-ae6bf95ee322 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:47:21.935657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-7a0fe2cb-9892-4768-8ad7-74ad2828553f tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6810183dc0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:21.997286 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-7a0fe2cb-9892-4768-8ad7-74ad2828553f tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0d47446f-ce41-40d4-8dcd-bc3237cb87d3" status: 200 len: 350 microversion: 2.1 time: 0.067558 Jul 29 14:47:21.997851 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 563/1136] 10.222.0.49 () {58 vars in 1245 bytes} [Fri Jul 29 14:47:21 2022] GET /compute/v2.1/os-volumes/0d47446f-ce41-40d4-8dcd-bc3237cb87d3 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:22.010561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-770dc519-7c75-4f1b-80a9-b6d18dca0763 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6803f22d30>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.093518 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-770dc519-7c75-4f1b-80a9-b6d18dca0763 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.087211 Jul 29 14:47:22.095155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 574/1137] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:22.109258 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9f3776b3-f8ff-4cfd-b8d5-7c5ca2549eac tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f68101f05e0>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.199619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9f3776b3-f8ff-4cfd-b8d5-7c5ca2549eac tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088233 Jul 29 14:47:22.199619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 564/1138] 10.222.0.49 () {58 vars in 1149 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:22.207935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bcc0cbcb-31ea-44b8-b737-aa90bf3397e1 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6803fc7280>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.291030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bcc0cbcb-31ea-44b8-b737-aa90bf3397e1 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.086721 Jul 29 14:47:22.291723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 575/1139] 10.222.0.49 () {58 vars in 1134 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:22.305320 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-26e7668b-6042-4561-8ff7-4d337e198a8a tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6810246e50>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.390908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-26e7668b-6042-4561-8ff7-4d337e198a8a tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090001 Jul 29 14:47:22.391491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 565/1140] 10.222.0.49 () {58 vars in 1167 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:22.404705 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e649161c-d0ff-4a80-a900-671f3a211d4d tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f68100fe5e0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.489582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e649161c-d0ff-4a80-a900-671f3a211d4d tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.088594 Jul 29 14:47:22.490046 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 576/1141] 10.222.0.49 () {58 vars in 1170 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:22.503199 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4c9a3c68-9068-42a7-a7ae-cda7dc683a78 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6810272820>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.583703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4c9a3c68-9068-42a7-a7ae-cda7dc683a78 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.084334 Jul 29 14:47:22.584955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 566/1142] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:22.598158 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-c9cafba4-09eb-468e-8bf1-3693a138e32a tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f68100b3ca0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.684286 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-c9cafba4-09eb-468e-8bf1-3693a138e32a tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.089858 Jul 29 14:47:22.684860 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 577/1143] 10.222.0.49 () {58 vars in 1188 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:47:22.699700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f3e83143-4c61-4971-9b0d-a7809e2f87f1 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] Calling method '.version_select at 0x7f6810246310>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:22.783991 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f3e83143-4c61-4971-9b0d-a7809e2f87f1 tempest-VolumesTestJSON-89772283 tempest-VolumesTestJSON-89772283-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088655 Jul 29 14:47:22.784581 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 567/1144] 10.222.0.49 () {58 vars in 1155 bytes} [Fri Jul 29 14:47:22 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:47:23.028935 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:23.030003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:23.038833 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:23.039293 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:23.040083 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:23.042371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:23.054642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 HTTP/1.1 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:47:23.056257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.057982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': 'd0ff1ddf-dd46-49f7-a6d8-cfacc188c464'} Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:23.058808 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.060010 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.061305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:23.061305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f6c5d5e0-038a-4237-b68b-58fc0af5d0c7 tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 404 len: 111 microversion: 2.20 time: 0.033233 Jul 29 14:47:23.061305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 578/1145] 10.222.0.49 () {60 vars in 1280 bytes} [Fri Jul 29 14:47:23 2022] DELETE /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 29 14:47:23.067619 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:47:23.073193 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] [instance: d0ff1ddf-dd46-49f7-a6d8-cfacc188c464] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:47:23.074993 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:23.076158 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:23.076295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:47:23.076653 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:47:23.090518 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] HTTP exception thrown: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Request method failure captured: Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 HTTP/1.1 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_A9freefNV_cZPdVMPmd6j3Gmwt1tetU_4ajs8hlh4PGC16_WsSzZBUXTwgc02oO6fjYCcAlSJi72lvmhT-m0cNRLvgmHAdD02ojg2ydfxPN3ioYmCs1fmaCEXqCp_DaymVwTf0st45KOf0q0jrQ582-u7PlBNolzh60rmwhE8mXbA Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Openstack-Nova-Api-Version: 2.20 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:47:23.092100 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/fdbc49e630fc461a858eb04c2dd52a82"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/fdbc49e630fc461a858eb04c2dd52a82"}]}] Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: fdbc49e630fc461a858eb04c2dd52a82 Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1132124538 Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: de769d721b8b49c6a5d7d391412da122 Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1132124538-project Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.093563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': 'd0ff1ddf-dd46-49f7-a6d8-cfacc188c464'} Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:47:23.094306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. Jul 29 14:47:23.095510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:47:23.096665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] Returning 404 to user: Instance d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:47:23.096665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8c3c87a3-5d56-4196-af25-70d11c6e7eae tempest-AttachVolumeShelveTestJSON-1132124538 tempest-AttachVolumeShelveTestJSON-1132124538-project] 10.222.0.49 "GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464" status: 404 len: 111 microversion: 2.20 time: 0.030945 Jul 29 14:47:23.096665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 568/1146] 10.222.0.49 () {60 vars in 1277 bytes} [Fri Jul 29 14:47:23 2022] GET /compute/v2.1/servers/d0ff1ddf-dd46-49f7-a6d8-cfacc188c464 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 29 14:49:06.580430 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:49:06.581074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:49:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:49:14.913074 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:49:14.913814 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:49:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:49:35.023759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:49:35.024318 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:49:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:49:39.298274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f6c642d-c267-4030-8813-a29fb47cf030] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 14:49:39.298965 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:39.299708 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=18 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:39.303642 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-913562735", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452"}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:39.356416 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] validate_networks() for None {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:49:39.634577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:49:39.634577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:49:39.634577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:49:39.634577 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:49:39.635209 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:49:39.644972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:39.645525 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:39.646535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:39.647036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:39.666228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Getting quotas for project 5d82f0f1c0a445d1b6c3b7b363c096be. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:49:39.671133 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Getting quotas for user ca3a3b1e03d5407ab19395fb4c0f2b91 and project 5d82f0f1c0a445d1b6c3b7b363c096be. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:49:39.686263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:49:39.686263 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:49:39.792938 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a8d8f4de-eb86-43d3-9db8-7408e304e59a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.496639 Jul 29 14:49:39.793881 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 579/1147] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:49:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:49:39.803296 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [715526b3-092e-4302-a0fa-fdb49621fce8] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 14:49:39.803984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:39.804769 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:39.811641 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c31f2959-ab65-4459-bd7c-f2d2b30f0436 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:39.812299 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c31f2959-ab65-4459-bd7c-f2d2b30f0436 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:39.881897 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-c31f2959-ab65-4459-bd7c-f2d2b30f0436 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:39.888842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c31f2959-ab65-4459-bd7c-f2d2b30f0436 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1214 microversion: 2.1 time: 0.087617 Jul 29 14:49:39.889632 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 569/1148] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:39 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:40.912005 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:40.912623 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:40.920296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:40.920841 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:40.921549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:40.922583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:40.940522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f6c642d-c267-4030-8813-a29fb47cf030] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52710. Jul 29 14:49:40.992313 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:40.999738 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a0797335-e708-4282-b96a-e005288c6e20 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1218 microversion: 2.1 time: 0.092548 Jul 29 14:49:41.000946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 580/1149] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:40 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:42.021607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:42.022226 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:42.032300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:42.032749 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:42.033590 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:42.034029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:42.039947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] [715526b3-092e-4302-a0fa-fdb49621fce8] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 52730. Jul 29 14:49:42.099569 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:42.107011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ef2faae9-592f-4954-a615-cb544af5262d tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1266 microversion: 2.1 time: 0.089683 Jul 29 14:49:42.108077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 570/1150] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:42 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1266 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:43.127613 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:43.128223 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:43.135019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:43.136927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:43.136927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:43.136927 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:43.202225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:43.209784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-dc0cf23f-3611-4e16-b209-d1fe53f48748 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1272 microversion: 2.1 time: 0.086064 Jul 29 14:49:43.211768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 581/1151] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:43 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1272 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:44.231331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:44.231989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:44.239236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:44.239687 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:44.240450 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:44.240887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:44.373592 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:44.381934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5a6b178b-78b7-4d91-b476-91bb8f91f949 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.154446 Jul 29 14:49:44.382507 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 571/1152] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:44 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:44.693698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-e1f8f41d-69fe-44ed-abad-9f8839eeb909 req-31e8bf04-e087-4e00-ade6-2f0e4317f725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec70c88-8009-4ecc-ba04-095e4d47fc02", "tag": "86f7b6b3-4a8d-4750-83e8-4193aaefceb0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:44.703859 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e1f8f41d-69fe-44ed-abad-9f8839eeb909 req-31e8bf04-e087-4e00-ade6-2f0e4317f725 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:44.704295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e1f8f41d-69fe-44ed-abad-9f8839eeb909 req-31e8bf04-e087-4e00-ade6-2f0e4317f725 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:44.715689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-e1f8f41d-69fe-44ed-abad-9f8839eeb909 req-31e8bf04-e087-4e00-ade6-2f0e4317f725 service nova] Creating event network-changed:86f7b6b3-4a8d-4750-83e8-4193aaefceb0 for instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 on hv-cinder-79987 Jul 29 14:49:44.721749 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-e1f8f41d-69fe-44ed-abad-9f8839eeb909 req-31e8bf04-e087-4e00-ade6-2f0e4317f725 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031667 Jul 29 14:49:44.722551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 582/1153] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:49:45.402184 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:45.402740 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:45.409263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:45.409709 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:45.410467 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:45.410899 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:45.541929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:45.550033 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-569ee81a-f374-4134-aef1-868596b7d3ed tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.151793 Jul 29 14:49:45.550604 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 572/1154] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:45 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:49:46.572400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:46.573295 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:46.580138 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:46.582800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:46.582800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:46.582800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:46.713571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:46.721679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-11710c25-8700-4a0d-8dd4-2b0337df30d1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.153888 Jul 29 14:49:46.722438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 583/1155] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:46 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:47.743790 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:47.744539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:47.751263 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:47.751716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:47.752559 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:47.753052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.004109 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:48.004609 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:48.011354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:48.011801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.012583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:48.013033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.043189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:49:48.198560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:48.208503 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-da64fb7a-3e0e-4a9b-abcd-d6c423cbb9ba tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.468626 Jul 29 14:49:48.209427 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 573/1156] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:47 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:48.214531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-e7c7c67a-afda-4c0c-ae94-f9c13af01f14 req-c46e3a39-c10d-415e-a80c-1629d41bbda6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:48.225417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e7c7c67a-afda-4c0c-ae94-f9c13af01f14 req-c46e3a39-c10d-415e-a80c-1629d41bbda6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:48.226047 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e7c7c67a-afda-4c0c-ae94-f9c13af01f14 req-c46e3a39-c10d-415e-a80c-1629d41bbda6 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.238121 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-e7c7c67a-afda-4c0c-ae94-f9c13af01f14 req-c46e3a39-c10d-415e-a80c-1629d41bbda6 service nova] Creating event network-changed:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:49:48.244978 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-e7c7c67a-afda-4c0c-ae94-f9c13af01f14 req-c46e3a39-c10d-415e-a80c-1629d41bbda6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034042 Jul 29 14:49:48.246018 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 574/1157] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:49:48.346861 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-23e93c95-3fc0-4517-85c1-2a7aa76a64c2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 204 len: 0 microversion: 2.1 time: 0.346524 Jul 29 14:49:48.347463 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 584/1158] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:49:47 2022] DELETE /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 29 14:49:48.356176 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:48.357408 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:48.364764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:48.365571 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.366833 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:48.367724 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:48.537475 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:48.545404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-24eb9be4-162e-4aa4-9934-d7a9136615ef tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.193470 Jul 29 14:49:48.545975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 575/1159] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:48 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:49.232614 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:49.233341 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:49.243091 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:49.243557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:49.244928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:49.244928 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:49.391019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:49.399322 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-981c63ab-ca7e-4aac-9b61-3bcf7d601dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.170918 Jul 29 14:49:49.399899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 585/1160] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:49 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:49.570819 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:49.572204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:49.584057 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:49.584937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:49.586162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:49.587035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:49.843441 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:49.851756 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e0c69f72-dce4-4a14-ac5e-b2380f40faf2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.287615 Jul 29 14:49:49.852631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 576/1161] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:49 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:50.419931 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:50.420544 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:50.423241 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:50.423994 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:50.429583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:50.430036 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:50.430894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:50.431338 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:50.597383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:50.605645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-71db92c7-8143-4a8f-811a-09e95655fda1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.189775 Jul 29 14:49:50.619442 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 586/1162] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:50 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:50.726642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:50.873234 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:50.876019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:50.881020 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-f9a59ccb-be78-4660-ac8e-ce94e71d165a req-15ed3559-8103-44cc-9498-bf486a89eaf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec70c88-8009-4ecc-ba04-095e4d47fc02", "name": "network-vif-plugged", "status": "completed", "tag": "86f7b6b3-4a8d-4750-83e8-4193aaefceb0"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:50.883797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:50.884049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:50.884950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:50.885562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:50.901072 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f9a59ccb-be78-4660-ac8e-ce94e71d165a req-15ed3559-8103-44cc-9498-bf486a89eaf8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:50.901892 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f9a59ccb-be78-4660-ac8e-ce94e71d165a req-15ed3559-8103-44cc-9498-bf486a89eaf8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:50.919150 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-f9a59ccb-be78-4660-ac8e-ce94e71d165a req-15ed3559-8103-44cc-9498-bf486a89eaf8 service nova] Creating event network-vif-plugged:86f7b6b3-4a8d-4750-83e8-4193aaefceb0 for instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 on hv-cinder-79987 Jul 29 14:49:50.924325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-f9a59ccb-be78-4660-ac8e-ce94e71d165a req-15ed3559-8103-44cc-9498-bf486a89eaf8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.202905 Jul 29 14:49:50.925027 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 577/1163] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:49:51.032849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:51.040603 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-22520380-6dcf-4766-8d62-ac72c38368f2 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.171461 Jul 29 14:49:51.041421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 587/1164] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:50 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:49:51.627701 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:51.628402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:51.634733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:51.642024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:51.642024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:51.642024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:51.784217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:51.793950 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6cb4784f-e722-4688-b2b5-9900672cff02 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.170859 Jul 29 14:49:51.795587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 578/1165] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:51 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:52.064182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:52.069087 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:52.071836 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:52.072289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:52.073081 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:52.073682 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:52.578379 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:52.586908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f09b2cae-154d-44fa-a917-a5ace1117a25 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.527143 Jul 29 14:49:52.588345 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 588/1166] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:52 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:52.821066 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:52.823765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:52.832674 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:52.833855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:52.834293 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:52.834797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:52.978398 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:52.987394 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b7159c6c-3a7c-4397-b1f3-2a9ad94c1dc1 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.174779 Jul 29 14:49:52.988331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 579/1167] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:52 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:53.608549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:53.610057 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:53.616899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:53.618034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:53.619423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:53.619856 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:53.761457 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:53.769126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-307e9209-ffef-4ea8-9dc2-593f42ba7274 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.164521 Jul 29 14:49:53.769685 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 589/1168] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:53 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:54.007753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:54.009129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:54.016282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:54.016726 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:54.017554 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:54.018088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:54.160002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:54.170283 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-266efc3f-d50d-4f1d-88a4-3075f6aa1378 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.166513 Jul 29 14:49:54.171029 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 580/1169] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:54 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:54.754196 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-bec8eb4a-cf0f-4323-96d3-7c05cf992d13 req-30b8e00f-d17a-40c0-8823-e892ff96d932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "name": "network-vif-unplugged", "status": "completed", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:54.765391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-bec8eb4a-cf0f-4323-96d3-7c05cf992d13 req-30b8e00f-d17a-40c0-8823-e892ff96d932 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:54.766208 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-bec8eb4a-cf0f-4323-96d3-7c05cf992d13 req-30b8e00f-d17a-40c0-8823-e892ff96d932 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:54.780879 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-bec8eb4a-cf0f-4323-96d3-7c05cf992d13 req-30b8e00f-d17a-40c0-8823-e892ff96d932 service nova] Creating event network-vif-unplugged:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:49:54.787225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-bec8eb4a-cf0f-4323-96d3-7c05cf992d13 req-30b8e00f-d17a-40c0-8823-e892ff96d932 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039969 Jul 29 14:49:54.788289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 590/1170] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:49:54.792985 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:54.793785 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:54.802557 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:54.803077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:54.804055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:54.804672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:54.953289 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:54.961492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4be292c6-1fca-40a0-9bfe-f5c62bb41b98 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.173997 Jul 29 14:49:54.962391 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 581/1171] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:54 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:55.192487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:55.193210 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:55.199332 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:55.199801 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:55.200550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:55.201006 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:55.346590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:55.354222 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5075456f-a70e-4233-8f9c-1825307e8c95 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.165923 Jul 29 14:49:55.354783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 591/1172] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:55 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:55.982916 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:55.983545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:55.991085 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:55.991844 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:55.992835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:55.993481 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:56.377240 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:56.378113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:56.388911 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:56.393599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:56.394589 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:56.395178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:56.406181 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:56.419893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-1e50a49a-a389-4188-850e-09b12c173c69 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1577 microversion: 2.1 time: 0.440590 Jul 29 14:49:56.420955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 582/1173] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:55 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1577 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:56.577970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:56.596243 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-08bad9e4-2038-4eaa-a9b4-a2c6f4b69028 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.221751 Jul 29 14:49:56.597783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 592/1174] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:56 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:56.716142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-d80aa3ff-317d-4f2f-be07-3f4ff67bb654 req-9f5e6048-9d50-4457-ba44-572af2aa3928 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a69432d-ca27-4f86-8585-f76166532ef1", "name": "network-vif-deleted", "tag": "e83cb432-169c-4960-abcf-426198bef1c0"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:49:56.733062 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d80aa3ff-317d-4f2f-be07-3f4ff67bb654 req-9f5e6048-9d50-4457-ba44-572af2aa3928 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:56.733616 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-d80aa3ff-317d-4f2f-be07-3f4ff67bb654 req-9f5e6048-9d50-4457-ba44-572af2aa3928 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:56.750612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-d80aa3ff-317d-4f2f-be07-3f4ff67bb654 req-9f5e6048-9d50-4457-ba44-572af2aa3928 service nova] Creating event network-vif-deleted:e83cb432-169c-4960-abcf-426198bef1c0 for instance 7a69432d-ca27-4f86-8585-f76166532ef1 on hv-cinder-79987 Jul 29 14:49:56.756116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-d80aa3ff-317d-4f2f-be07-3f4ff67bb654 req-9f5e6048-9d50-4457-ba44-572af2aa3928 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053826 Jul 29 14:49:56.757197 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 583/1175] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:49:57.445231 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:57.446033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:57.464783 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:57.465402 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:57.466335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:57.466906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:57.564126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:57.573300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-6ef2b0cc-44dc-4461-8cde-ece29eada26c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1225 microversion: 2.1 time: 0.134282 Jul 29 14:49:57.574149 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 593/1176] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:57 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1225 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:57.619760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:57.621102 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:57.628938 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:57.629643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:57.630716 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:57.631358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:57.854802 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:57.863269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5b10a841-5d08-4a61-a72b-4cd0f53529c6 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1314 microversion: 2.1 time: 0.248293 Jul 29 14:49:57.866253 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 584/1177] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:57 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:58.596112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:58.596764 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:58.608741 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:58.609273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:58.613117 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:58.614555 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:58.666767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:58.667568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:58.668200 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lazy-loading 'fault' on Instance uuid 7a69432d-ca27-4f86-8585-f76166532ef1 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:49:58.732355 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:58.742253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-def4b1f7-7e39-468d-9440-02a4571fda3b tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 200 len: 1230 microversion: 2.1 time: 0.150254 Jul 29 14:49:58.743685 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 594/1178] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:58 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 1230 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:58.887315 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:58.889236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:58.902656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:58.906067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:58.908904 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:58.909411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.180120 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:59.194232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-28310da0-e950-4fa7-b818-9e91b576ce42 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1463 microversion: 2.1 time: 0.312079 Jul 29 14:49:59.196223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 585/1179] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:58 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1463 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:49:59.250784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:59.251305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:59.260671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.260671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.260671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.260671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.295187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:49:59.307788 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Going to try to terminate instance {{(pid=124771) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:49:59.592517 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0835b884-2844-4c4c-a010-d71dd932aa0a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "DELETE /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 204 len: 0 microversion: 2.1 time: 0.346254 Jul 29 14:49:59.593364 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 595/1180] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:49:59 2022] DELETE /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:49:59.610260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:59.610260 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:59.612599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.613087 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.613887 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.614325 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.796431 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:49:59.800400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 7a69432d-ca27-4f86-8585-f76166532ef1] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:49:59.808713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.809750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.810538 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:49:59.810976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:49:59.830399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] HTTP exception thrown: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Request method failure captured: Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 HTTP/1.1 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_Eu94sf8QgTIB90reYSsID2p_Kgsu82Q474Q2Dk9Dp-N_w0UyfrylITqk7vuLBVYs1QNSNwuMsvAcxYx0S3uaOla6dSyZU9ULMFjYvlWUBSnki-3x5JcLL8US75czk32o_RqQ2gqMalLO8IsCrkgpYX_Q0FieF9beZCBo5PcIkIg3E Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:49:59.836715 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10f1fba5db2b4402b2fe8d12d099e331"}]}] Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f9360a76354e4ae99668fe8debe4e7fb Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. Jul 29 14:49:59.838394 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '7a69432d-ca27-4f86-8585-f76166532ef1'} Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:49:59.839188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. Jul 29 14:49:59.840923 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:49:59.844289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Returning 404 to user: Instance 7a69432d-ca27-4f86-8585-f76166532ef1 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:49:59.844289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7523b936-2996-4c72-a5ee-81af590e8b6c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1" status: 404 len: 111 microversion: 2.1 time: 0.073032 Jul 29 14:49:59.844289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 596/1181] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:59 2022] GET /compute/v2.1/servers/7a69432d-ca27-4f86-8585-f76166532ef1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:49:59.952290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:49:59.965854 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-5603c4d2-6ebc-4ff7-acb5-aa82e91cc741 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1469 microversion: 2.1 time: 0.367509 Jul 29 14:49:59.966478 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 586/1182] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:49:59 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1469 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:00.712301 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7a805b55-4cbf-41be-b457-33e7d348c5ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Action: 'create', calling method: .version_select at 0x7f6810112a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-285597735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIUEEGMLMH/MDRdiZ1MVgp1iJsNyjlETjasCygZ7GqSulRD44D7MxoIlt3wNmaI6MGk2t3GH16WgfW103ybFiys4XjkkndG6IzDlxTa++6TX+NlHM7pQPRoSfrsmDzAaw=="}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:00.732395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-7a805b55-4cbf-41be-b457-33e7d348c5ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Getting quotas for project be1df25ae6404f33b88dda96469e9a7e. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:50:00.738766 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-7a805b55-4cbf-41be-b457-33e7d348c5ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Getting quotas for user 24992429cbbd47f3958e0de1be93916a and project be1df25ae6404f33b88dda96469e9a7e. Resources: {'key_pairs'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:50:00.803815 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7a805b55-4cbf-41be-b457-33e7d348c5ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.269058 Jul 29 14:50:00.804503 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 597/1183] 10.222.0.49 () {60 vars in 1159 bytes} [Fri Jul 29 14:50:00 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:50:00.988649 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:00.989469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:00.996567 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:00.997211 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:00.998026 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:00.998541 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:01.161201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:01.174705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0712f3e9-8d59-4521-813a-c4c850148b7b tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1469 microversion: 2.1 time: 0.187496 Jul 29 14:50:01.174705 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 587/1184] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:00 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:01.888490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-e358647c-4b84-45ea-8eb6-c0c299833e48 req-74168089-60cf-44ae-ac82-9e436410d36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec70c88-8009-4ecc-ba04-095e4d47fc02", "name": "network-vif-deleted", "tag": "86f7b6b3-4a8d-4750-83e8-4193aaefceb0"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:01.902908 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e358647c-4b84-45ea-8eb6-c0c299833e48 req-74168089-60cf-44ae-ac82-9e436410d36e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:01.909425 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-e358647c-4b84-45ea-8eb6-c0c299833e48 req-74168089-60cf-44ae-ac82-9e436410d36e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:01.915348 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-e358647c-4b84-45ea-8eb6-c0c299833e48 req-74168089-60cf-44ae-ac82-9e436410d36e service nova] Creating event network-vif-deleted:86f7b6b3-4a8d-4750-83e8-4193aaefceb0 for instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 on hv-cinder-79987 Jul 29 14:50:01.920557 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-e358647c-4b84-45ea-8eb6-c0c299833e48 req-74168089-60cf-44ae-ac82-9e436410d36e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035682 Jul 29 14:50:01.921634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 598/1185] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:02.197285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:02.198116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:02.205657 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:02.206185 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:02.207035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:02.207566 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:02.229925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=100 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:02.274774 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3a3b1e03d5407ab19395fb4c0f2b91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d82f0f1c0a445d1b6c3b7b363c096be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:02.283108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-029b572f-8b69-4875-8440-4e6f70068567 tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 200 len: 1299 microversion: 2.1 time: 0.090910 Jul 29 14:50:02.293372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 588/1186] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:02 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:03.306578 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:03.308107 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] [instance: 4ec70c88-8009-4ecc-ba04-095e4d47fc02] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:03.316703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:03.317189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:03.318171 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:03.318646 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:03.337683 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] HTTP exception thrown: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Request method failure captured: Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 HTTP/1.1 Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_OALh-mbA5nboZJHQ_ERis4-4yDaipHg2ZGDGFsMrVbUj9wSbubFA55nljRqpMQp9Xr2cqArlIETsmkJ7XHHgcOKLa2Wy1rXDwmle8LoRIhl0-wTQbmS7TL2ZhB7PpphZZmG5mDtBfwBKfjES4cNP6gHSpSSQRJhkFv-KWIE9-hAHY Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 5d82f0f1c0a445d1b6c3b7b363c096be Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-VolumesNegativeTest-860310303 Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:50:03.339840 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_5d82f0f1c0a445d1b6c3b7b363c096be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d82f0f1c0a445d1b6c3b7b363c096be"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/5d82f0f1c0a445d1b6c3b7b363c096be"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/5d82f0f1c0a445d1b6c3b7b363c096be"}]}] Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-VolumesNegativeTest-860310303 Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 5d82f0f1c0a445d1b6c3b7b363c096be Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-VolumesNegativeTest-860310303 Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-VolumesNegativeTest-860310303-project Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: ca3a3b1e03d5407ab19395fb4c0f2b91 Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-VolumesNegativeTest-860310303-project Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. Jul 29 14:50:03.341740 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '4ec70c88-8009-4ecc-ba04-095e4d47fc02'} Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:50:03.342837 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. Jul 29 14:50:03.344820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:03.347199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] Returning 404 to user: Instance 4ec70c88-8009-4ecc-ba04-095e4d47fc02 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:50:03.349569 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9683b2f5-cc8e-4b86-9c45-5fc5d314545a tempest-VolumesNegativeTest-860310303 tempest-VolumesNegativeTest-860310303-project] 10.222.0.49 "GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02" status: 404 len: 111 microversion: 2.1 time: 0.048739 Jul 29 14:50:03.350160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 599/1187] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:03 2022] GET /compute/v2.1/servers/4ec70c88-8009-4ecc-ba04-095e4d47fc02 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:50:03.752038 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:03.752613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:03.765751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:03.766217 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:03.767010 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:03.767457 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:03.814846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:50:03.938391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-742a3123-bf1b-43e1-b103-79c5c535cf4c req-3a5492d1-e08a-4498-b14f-fb653370bc32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd5b621-deb0-400f-8a0c-53cf309b634c", "tag": "fca761d5-971a-4e4c-bae3-800888a36beb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:03.947899 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-742a3123-bf1b-43e1-b103-79c5c535cf4c req-3a5492d1-e08a-4498-b14f-fb653370bc32 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:03.948354 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-742a3123-bf1b-43e1-b103-79c5c535cf4c req-3a5492d1-e08a-4498-b14f-fb653370bc32 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:03.968580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-742a3123-bf1b-43e1-b103-79c5c535cf4c req-3a5492d1-e08a-4498-b14f-fb653370bc32 service nova] Creating event network-changed:fca761d5-971a-4e4c-bae3-800888a36beb for instance ddd5b621-deb0-400f-8a0c-53cf309b634c on hv-cinder-79987 Jul 29 14:50:03.973983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-742a3123-bf1b-43e1-b103-79c5c535cf4c req-3a5492d1-e08a-4498-b14f-fb653370bc32 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Jul 29 14:50:03.975096 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 600/1188] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:50:04.286331 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-77f86432-ac2a-4c4a-816e-b0add333f273 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 204 len: 0 microversion: 2.1 time: 0.538736 Jul 29 14:50:04.286925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 589/1189] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:50:03 2022] DELETE /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:50:04.300482 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:04.301614 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:04.309236 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:04.309910 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:04.310350 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:04.310794 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:04.504471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:04.514402 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a3b1fb6b-4654-4a15-92bd-217f18df919f tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1576 microversion: 2.1 time: 0.222869 Jul 29 14:50:04.529692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 601/1190] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:04 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:05.538193 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:05.538911 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:05.545692 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:05.546145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:05.547525 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:05.547973 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:05.637834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:05.646539 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-09f01700-ca0d-4e07-b708-2ec97b497656 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1391 microversion: 2.1 time: 0.112877 Jul 29 14:50:05.647203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 590/1191] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:05 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1391 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:05.989655 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-b6956098-dce3-419d-a93e-7eac4ace5c82 req-1832b72d-c9ee-4fd8-8ad9-28989c6637b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd5b621-deb0-400f-8a0c-53cf309b634c", "name": "network-vif-deleted", "tag": "fca761d5-971a-4e4c-bae3-800888a36beb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:06.001043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b6956098-dce3-419d-a93e-7eac4ace5c82 req-1832b72d-c9ee-4fd8-8ad9-28989c6637b1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:06.001777 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-b6956098-dce3-419d-a93e-7eac4ace5c82 req-1832b72d-c9ee-4fd8-8ad9-28989c6637b1 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:06.013439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-b6956098-dce3-419d-a93e-7eac4ace5c82 req-1832b72d-c9ee-4fd8-8ad9-28989c6637b1 service nova] Creating event network-vif-deleted:fca761d5-971a-4e4c-bae3-800888a36beb for instance ddd5b621-deb0-400f-8a0c-53cf309b634c on hv-cinder-79987 Jul 29 14:50:06.019580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-b6956098-dce3-419d-a93e-7eac4ace5c82 req-1832b72d-c9ee-4fd8-8ad9-28989c6637b1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033781 Jul 29 14:50:06.020399 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 602/1192] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:50:06.668767 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:06.669691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:06.677391 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:06.677970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:06.678753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:06.679546 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:06.717862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:06.718318 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:06.718813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.objects.instance [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lazy-loading 'fault' on Instance uuid ddd5b621-deb0-400f-8a0c-53cf309b634c {{(pid=124772) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:50:06.771700 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9360a76354e4ae99668fe8debe4e7fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10f1fba5db2b4402b2fe8d12d099e331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:06.778259 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-72ebec48-b0ef-4e34-8521-0dab48a97b2c tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 200 len: 1230 microversion: 2.1 time: 0.113576 Jul 29 14:50:06.779008 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 591/1193] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:06 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:07.800853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:07.801584 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: ddd5b621-deb0-400f-8a0c-53cf309b634c] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:07.807964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:07.808490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:07.809201 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:07.809635 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:07.825140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] HTTP exception thrown: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Request method failure captured: Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c HTTP/1.1 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_Eu94sf8QgTIB90reYSsID2p_Kgsu82Q474Q2Dk9Dp-N_w0UyfrylITqk7vuLBVYs1QNSNwuMsvAcxYx0S3uaOla6dSyZU9ULMFjYvlWUBSnki-3x5JcLL8US75czk32o_RqQ2gqMalLO8IsCrkgpYX_Q0FieF9beZCBo5PcIkIg3E Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:50:07.826870 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10f1fba5db2b4402b2fe8d12d099e331"}]}] Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f9360a76354e4ae99668fe8debe4e7fb Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. Jul 29 14:50:07.829175 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': 'ddd5b621-deb0-400f-8a0c-53cf309b634c'} Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:50:07.831101 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. Jul 29 14:50:07.832944 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:07.834571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Returning 404 to user: Instance ddd5b621-deb0-400f-8a0c-53cf309b634c could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:50:07.834571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-4358e5ba-8740-40aa-b2f1-d70f6ae25541 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c" status: 404 len: 111 microversion: 2.1 time: 0.032869 Jul 29 14:50:07.834571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 603/1194] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:07 2022] GET /compute/v2.1/servers/ddd5b621-deb0-400f-8a0c-53cf309b634c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 29 14:50:08.363270 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:08.363787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:08.370781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:08.371257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:08.372129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:08.372763 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:08.389161 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] HTTP exception thrown: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Request method failure captured: Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: DELETE /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 HTTP/1.1 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_Eu94sf8QgTIB90reYSsID2p_Kgsu82Q474Q2Dk9Dp-N_w0UyfrylITqk7vuLBVYs1QNSNwuMsvAcxYx0S3uaOla6dSyZU9ULMFjYvlWUBSnki-3x5JcLL8US75czk32o_RqQ2gqMalLO8IsCrkgpYX_Q0FieF9beZCBo5PcIkIg3E Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:50:08.391164 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10f1fba5db2b4402b2fe8d12d099e331"}]}] Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: f9360a76354e4ae99668fe8debe4e7fb Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.392848 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '6275089c-3a8d-4785-9bea-bfa300e57580'} Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:50:08.393745 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.395276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.397138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Returning 404 to user: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:50:08.397138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-775585e1-0c42-4481-9f02-c8ce56b38109 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 404 len: 111 microversion: 2.1 time: 0.034403 Jul 29 14:50:08.397138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 592/1195] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:50:08 2022] DELETE /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:50:08.402160 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:08.403012 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] [instance: 6275089c-3a8d-4785-9bea-bfa300e57580] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:08.409294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:08.409919 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:08.410768 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:08.411280 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:08.426003 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.wsgi [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] HTTP exception thrown: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Request method failure captured: Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: request: GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 HTTP/1.1 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept: application/json Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Accept-Encoding: identity Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Connection: close Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Length: 0 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Content-Type: application/json Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Host: 10.222.0.49 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Openstack-System-Scope: None Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: User-Agent: python-urllib3/1.26.10 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Auth-Token: gAAAAABi4_Eu94sf8QgTIB90reYSsID2p_Kgsu82Q474Q2Dk9Dp-N_w0UyfrylITqk7vuLBVYs1QNSNwuMsvAcxYx0S3uaOla6dSyZU9ULMFjYvlWUBSnki-3x5JcLL8US75czk32o_RqQ2gqMalLO8IsCrkgpYX_Q0FieF9beZCBo5PcIkIg3E Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Id: None Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Domain-Name: None Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Identity-Status: Confirmed Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Is-Admin-Project: True Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Id: default Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Domain-Name: Default Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Project-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Role: member,reader Jul 29 14:50:08.427531 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Roles: member,reader Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10f1fba5db2b4402b2fe8d12d099e331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10f1fba5db2b4402b2fe8d12d099e331"}]}] Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Id: 10f1fba5db2b4402b2fe8d12d099e331 Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-Tenant-Name: tempest-TestVolumeBootPattern-1144180800 Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Id: default Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Domain-Name: Default Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Id: f9360a76354e4ae99668fe8debe4e7fb Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: X-User-Name: tempest-TestVolumeBootPattern-1144180800-project Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: method: > Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: exception: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.429199 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: action_args: {'id': '6275089c-3a8d-4785-9bea-bfa300e57580'} Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:50:08.430183 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. Jul 29 14:50:08.431778 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR nova.api.openstack.wsgi Jul 29 14:50:08.433363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Returning 404 to user: Instance 6275089c-3a8d-4785-9bea-bfa300e57580 could not be found. {{(pid=124771) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:50:08.433363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d684f83b-c91e-473c-8bc6-88b03b49914e tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580" status: 404 len: 111 microversion: 2.1 time: 0.030847 Jul 29 14:50:08.433363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 604/1196] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:08 2022] GET /compute/v2.1/servers/6275089c-3a8d-4785-9bea-bfa300e57580 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:50:09.988049 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-497014c7-1491-4214-ac4b-c2ac36c9b706 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] Calling method '.version_select at 0x7f6810559790>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:10.070747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-497014c7-1491-4214-ac4b-c2ac36c9b706 tempest-TestVolumeBootPattern-1144180800 tempest-TestVolumeBootPattern-1144180800-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345170100" status: 202 len: 0 microversion: 2.1 time: 0.086692 Jul 29 14:50:10.071363 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 593/1197] 10.222.0.49 () {58 vars in 1263 bytes} [Fri Jul 29 14:50:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1345170100 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:50:16.503820 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-818416356", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "networks": [{"uuid": "84f2d907-752b-4efa-bdda-5e792b6ed1aa"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:16.515839 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:16.522969 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:16.565853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] validate_networks() for [('84f2d907-752b-4efa-bdda-5e792b6ed1aa', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:50:17.061929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:50:17.062340 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:50:17.062813 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:50:17.063217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:50:17.063728 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:50:17.075556 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:17.076163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:17.081178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:17.081178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:17.094460 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Getting quotas for project dc6ddeb0546943f99c7e8610686183f5. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:50:17.099710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Getting quotas for user bc265dfa04054c7ca16bdabed4146dd8 and project dc6ddeb0546943f99c7e8610686183f5. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:50:17.112103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:50:17.114512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:50:17.308375 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-57484154-c14a-4d13-88b0-30e013721908 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.809361 Jul 29 14:50:17.311665 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 605/1198] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:50:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:50:17.323429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-9a1a8d48-53c5-43cb-8be2-203f60d3d842 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:17.323816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-9a1a8d48-53c5-43cb-8be2-203f60d3d842 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:17.328257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:17.400741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-9a1a8d48-53c5-43cb-8be2-203f60d3d842 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:17.411163 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-9a1a8d48-53c5-43cb-8be2-203f60d3d842 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1218 microversion: 2.1 time: 0.092197 Jul 29 14:50:17.425170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 594/1199] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:17 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:18.432395 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a7ca1e3a-9c0f-4011-a10b-b4a69452ad31 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:18.433060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a7ca1e3a-9c0f-4011-a10b-b4a69452ad31 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:18.506674 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a7ca1e3a-9c0f-4011-a10b-b4a69452ad31 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:18.514388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a7ca1e3a-9c0f-4011-a10b-b4a69452ad31 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1218 microversion: 2.1 time: 0.086461 Jul 29 14:50:18.515186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 606/1200] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:18 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:19.536764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:19.537403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:19.539609 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:19.545082 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:19.545542 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:19.546309 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:19.546747 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:19.609886 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:19.617563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ac5cd5eb-7126-4f99-8024-ac68729b5697 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1270 microversion: 2.1 time: 0.085766 Jul 29 14:50:19.629815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 595/1201] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:19 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:20.643219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:20.644197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:20.651497 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:20.651946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:20.652765 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:20.653225 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:20.888748 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:20.896929 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-aa2e7c52-5eac-4ca7-a408-d9de4e6627f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.257661 Jul 29 14:50:20.897519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 607/1202] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:20 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:21.418588 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-e9b86b53-2a18-4f0b-80bc-0abb07d21aee req-0d8db877-6257-4f7a-bc85-4b5f071e2913 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3560fb1e-3c16-40a8-b9c1-cd4618deb5b0", "tag": "470b5bfc-04bf-434d-a76c-ecfcafb56cdb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:21.430012 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e9b86b53-2a18-4f0b-80bc-0abb07d21aee req-0d8db877-6257-4f7a-bc85-4b5f071e2913 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:21.430459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-e9b86b53-2a18-4f0b-80bc-0abb07d21aee req-0d8db877-6257-4f7a-bc85-4b5f071e2913 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:21.442290 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-e9b86b53-2a18-4f0b-80bc-0abb07d21aee req-0d8db877-6257-4f7a-bc85-4b5f071e2913 service nova] Creating event network-changed:470b5bfc-04bf-434d-a76c-ecfcafb56cdb for instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 on hv-cinder-79987 Jul 29 14:50:21.447186 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-e9b86b53-2a18-4f0b-80bc-0abb07d21aee req-0d8db877-6257-4f7a-bc85-4b5f071e2913 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033446 Jul 29 14:50:21.447935 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 596/1203] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:21.918310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:21.918924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:21.926153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:21.926604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:21.927385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:21.927825 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:22.130924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:22.138973 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-886f94ec-d60b-49d0-9c24-5d7e24e16986 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.224506 Jul 29 14:50:22.139551 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 608/1204] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:21 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:23.162068 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:23.162800 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:23.170241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:23.170690 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:23.171459 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:23.171921 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:23.302807 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:23.310201 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e89b6808-c316-4ed7-a522-11231200eb4f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.154246 Jul 29 14:50:23.310758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 597/1205] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:23 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:24.330865 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:24.331712 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:24.338219 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:24.338662 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:24.339418 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:24.339847 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:24.464486 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:24.472796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-429299a7-cc2a-45f8-9600-6aa22cb90930 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.145613 Jul 29 14:50:24.473391 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 609/1206] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:24 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:25.493929 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:25.494473 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:25.500845 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:25.501319 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:25.502077 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:25.502509 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:25.638390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:25.645919 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4398a3cb-4591-4f03-8762-5a1350d59035 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.155956 Jul 29 14:50:25.646520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 598/1207] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:25 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:26.060571 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-844492808", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-285597735", "security_groups": [{"name": "tempest-secgroup-smoke-454839132"}], "networks": [{"uuid": "a0b48b8d-4d1b-41c1-87c8-35113c28c610"}], "block_device_mapping_v2": [{"uuid": "445695be-564e-4209-b3b3-24b71e36990d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:26.177400 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] validate_networks() for [('a0b48b8d-4d1b-41c1-87c8-35113c28c610', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:50:26.537703 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:50:26.538154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:50:26.538629 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:50:26.539043 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:50:26.539453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:50:26.548267 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:26.548767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:26.549594 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:26.550147 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:26.567454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Getting quotas for project be1df25ae6404f33b88dda96469e9a7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:50:26.571303 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Getting quotas for user 24992429cbbd47f3958e0de1be93916a and project be1df25ae6404f33b88dda96469e9a7e. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:50:26.629328 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:50:26.631365 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='445695be-564e-4209-b3b3-24b71e36990d',volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:50:26.667661 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:26.668280 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:26.676603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:26.677091 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:26.677882 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:26.678326 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:26.816250 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:26.823750 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4c068b31-dbc1-403d-9197-cf5c3e2cd45f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.160533 Jul 29 14:50:26.824307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 599/1208] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:26 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:26.985273 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ef0130f3-ef5f-4919-bb46-5b8fe2bd53bd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.928360 Jul 29 14:50:26.986268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 610/1209] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:50:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 29 14:50:26.996828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f1ebbf44-75c5-449c-a661-24d238ae7c94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:26.997599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f1ebbf44-75c5-449c-a661-24d238ae7c94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:27.052537 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f1ebbf44-75c5-449c-a661-24d238ae7c94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:27.059114 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f1ebbf44-75c5-449c-a661-24d238ae7c94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1087 microversion: 2.1 time: 0.066138 Jul 29 14:50:27.059685 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 600/1210] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:26 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:27.843672 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:27.844285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:27.851757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:27.856366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:27.856366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:27.856366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:27.984475 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:27.992561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-44847bbe-88dd-4b09-ab41-8121a784c335 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.152788 Jul 29 14:50:27.993174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 611/1211] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:27 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:28.079987 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:28.080602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:28.087658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:28.088116 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:28.088891 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:28.089358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:28.150532 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:28.162006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-57262621-6496-492f-ba0e-c449f906a71b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1137 microversion: 2.1 time: 0.081897 Jul 29 14:50:28.162006 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 601/1212] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:28 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:28.830067 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-277fb061-5f65-4a14-99ba-9ece175bc3a8 req-aff0fd4f-dc95-483a-87fa-98c9aeb1f4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3560fb1e-3c16-40a8-b9c1-cd4618deb5b0", "name": "network-vif-plugged", "status": "completed", "tag": "470b5bfc-04bf-434d-a76c-ecfcafb56cdb"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:28.840177 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-277fb061-5f65-4a14-99ba-9ece175bc3a8 req-aff0fd4f-dc95-483a-87fa-98c9aeb1f4dc service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:28.840561 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-277fb061-5f65-4a14-99ba-9ece175bc3a8 req-aff0fd4f-dc95-483a-87fa-98c9aeb1f4dc service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:28.852215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-277fb061-5f65-4a14-99ba-9ece175bc3a8 req-aff0fd4f-dc95-483a-87fa-98c9aeb1f4dc service nova] Creating event network-vif-plugged:470b5bfc-04bf-434d-a76c-ecfcafb56cdb for instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 on hv-cinder-79987 Jul 29 14:50:28.856941 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-277fb061-5f65-4a14-99ba-9ece175bc3a8 req-aff0fd4f-dc95-483a-87fa-98c9aeb1f4dc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030565 Jul 29 14:50:28.857563 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 612/1213] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:29.013432 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:29.014078 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:29.020973 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:29.021436 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:29.022209 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:29.022697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:29.161928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:29.169787 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2ad4c9b4-aca4-4c03-97b2-08faaa910d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.159994 Jul 29 14:50:29.170354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 602/1214] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:29 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:29.181848 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:29.182607 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:29.188817 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:29.189300 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:29.190058 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:29.190491 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:29.253174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:29.261218 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ec63a080-83dd-4966-ae6d-cfb0e923f14d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1185 microversion: 2.1 time: 0.083585 Jul 29 14:50:29.261776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 613/1215] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:29 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:30.191772 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:30.192531 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:30.199180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:30.199627 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:30.200440 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:30.200879 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:30.283113 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:30.283719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:30.291070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:30.291521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:30.292462 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:30.292896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:30.335182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:30.343310 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-871e8064-a0cb-4bfe-93d5-1258925ea13c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1318 microversion: 2.1 time: 0.155917 Jul 29 14:50:30.343897 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 603/1216] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:30 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:30.370671 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:30.378119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-085ed175-c4e4-4d98-ab73-dfe8a25cef8f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1203 microversion: 2.1 time: 0.098887 Jul 29 14:50:30.379419 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 614/1217] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:30 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:31.363955 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:31.364562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:31.370947 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:31.371408 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:31.372174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:31.377210 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:31.400522 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:31.401250 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:31.408120 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:31.408679 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:31.409604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:31.410767 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:31.414111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:31.518000 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:31.528359 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a1f2196b-c68e-4d72-b7b4-04df8f1d13a5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1506 microversion: 2.1 time: 0.168275 Jul 29 14:50:31.535608 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 604/1218] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:31 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:31.628026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:31.639769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-de08aae8-16d0-442f-b537-a6a703b24397 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1270 microversion: 2.1 time: 0.242792 Jul 29 14:50:31.640361 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 615/1219] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:31 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1270 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:50:31.760874 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-f4e4feda-73a0-468d-8e98-f9638b8fef19 req-54a06a41-dcd7-4d6a-b9bb-9e8dc9da9a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:31.776159 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f4e4feda-73a0-468d-8e98-f9638b8fef19 req-54a06a41-dcd7-4d6a-b9bb-9e8dc9da9a11 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:31.776599 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-f4e4feda-73a0-468d-8e98-f9638b8fef19 req-54a06a41-dcd7-4d6a-b9bb-9e8dc9da9a11 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:31.799954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-f4e4feda-73a0-468d-8e98-f9638b8fef19 req-54a06a41-dcd7-4d6a-b9bb-9e8dc9da9a11 service nova] Creating event network-changed:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:50:31.806717 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-f4e4feda-73a0-468d-8e98-f9638b8fef19 req-54a06a41-dcd7-4d6a-b9bb-9e8dc9da9a11 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050632 Jul 29 14:50:31.807908 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 605/1220] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:32.661734 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:32.662382 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:32.669197 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:32.669918 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:32.670692 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:32.671133 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:32.807026 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:32.814473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8b954875-72ab-4a0a-a828-a320c7c7a953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.156623 Jul 29 14:50:32.818752 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 616/1221] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:32 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:33.837817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:33.838589 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:33.844760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:33.845247 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:33.846011 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:33.846487 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:34.193830 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:34.201232 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-a347b6b9-8f0e-4f29-bb2b-4a13a1ffcd77 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.368492 Jul 29 14:50:34.201782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 606/1222] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:33 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:35.221797 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:35.222404 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:35.229056 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:35.229502 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:35.230271 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:35.230704 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:35.416221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:35.423863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-893c9ced-54e2-44b8-8639-385de021685e tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.205924 Jul 29 14:50:35.424427 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 617/1223] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:35 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:36.446273 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:36.446835 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:36.453765 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:36.454224 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:36.455002 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:36.455466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:36.591305 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:36.598982 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-3121024c-f727-4f77-8fbc-75c9ffb70b09 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.157373 Jul 29 14:50:36.599545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 607/1224] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:36 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:37.621421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:37.622030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:37.624334 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=4 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:37.625034 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=14 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:37.630227 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:37.631169 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:37.635103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:37.635103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:37.769178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:37.778485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ec27cf47-b928-490b-bcd9-15c94322f522 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.160726 Jul 29 14:50:37.779073 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 618/1225] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:37 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:38.799295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:38.799924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:38.801895 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=4 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:38.807431 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:38.814067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:38.814067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:38.814067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:38.948762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:38.956514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ad3219b3-c778-46ec-8f54-b7181930b254 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.161018 Jul 29 14:50:38.957568 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 608/1226] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:38 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:39.981055 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:39.982000 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:39.988648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:39.989139 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:39.989921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:39.990964 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:40.126616 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:40.134150 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ee756306-38cc-4bcf-86df-f0597b45282d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.159913 Jul 29 14:50:40.134713 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 619/1227] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:39 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:41.155060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:41.155766 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:41.162658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:41.163040 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:41.163828 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:41.164300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:41.295374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:41.303679 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-8ee27abe-0569-4578-beb6-cb2d6534616a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.151789 Jul 29 14:50:41.304251 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 609/1228] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:41 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:42.324784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:42.325550 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:42.331504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:42.331954 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:42.332718 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:42.333185 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:42.464732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:42.472560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5de641e7-b39d-48b3-ac6a-fc5842c30d46 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.151942 Jul 29 14:50:42.473162 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 620/1229] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:42 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:42.844027 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-9274247a-042c-483f-a1f6-2d9ff8fff4fd req-f1922401-8f85-4cec-ad62-d3e616fc1528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "name": "network-vif-plugged", "status": "completed", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:42.854768 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-9274247a-042c-483f-a1f6-2d9ff8fff4fd req-f1922401-8f85-4cec-ad62-d3e616fc1528 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:42.855347 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-9274247a-042c-483f-a1f6-2d9ff8fff4fd req-f1922401-8f85-4cec-ad62-d3e616fc1528 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:42.869302 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-9274247a-042c-483f-a1f6-2d9ff8fff4fd req-f1922401-8f85-4cec-ad62-d3e616fc1528 service nova] Creating event network-vif-plugged:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:50:42.874607 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-9274247a-042c-483f-a1f6-2d9ff8fff4fd req-f1922401-8f85-4cec-ad62-d3e616fc1528 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035400 Jul 29 14:50:42.875513 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 610/1230] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:43.493485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:43.494115 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:43.500830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:43.501325 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:43.502102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:43.502549 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:43.632897 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:43.641011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3edb8503-0552-439a-bd3b-3235bdd6e4dd tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.151511 Jul 29 14:50:43.641585 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 621/1231] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:43 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:44.662902 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:44.663631 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:44.670643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:44.671093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:44.671860 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:44.672297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:44.802708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:44.810815 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4c4797db-effe-44fa-a05d-dcaac8a409c6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1258 microversion: 2.1 time: 0.152682 Jul 29 14:50:44.811384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 611/1232] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:44 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:45.832119 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:45.832719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:45.839307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:45.839755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:45.840516 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:45.840946 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:45.975023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:45.983111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd205b29-c885-4536-a21a-893a44413953 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1441 microversion: 2.1 time: 0.154899 Jul 29 14:50:45.984906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 622/1233] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:45 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1441 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:46.003731 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:50:46.004353 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:46.011527 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:46.011975 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:46.012758 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:46.013231 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:46.359925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:50:46.367877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-bb15d49c-08c5-495d-b997-d7f6ef422c28 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1441 microversion: 2.1 time: 0.367446 Jul 29 14:50:46.368551 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 612/1234] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:50:45 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1441 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:50:48.447053 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-465ccfef-aeef-4873-994e-87a3b849d804 req-4757d4f8-194a-4336-a564-95b3db9c0cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:48.451967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:48.457330 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-465ccfef-aeef-4873-994e-87a3b849d804 req-4757d4f8-194a-4336-a564-95b3db9c0cc9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:48.457782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-465ccfef-aeef-4873-994e-87a3b849d804 req-4757d4f8-194a-4336-a564-95b3db9c0cc9 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:48.469645 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-465ccfef-aeef-4873-994e-87a3b849d804 req-4757d4f8-194a-4336-a564-95b3db9c0cc9 service nova] Creating event network-changed:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:50:48.474666 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-465ccfef-aeef-4873-994e-87a3b849d804 req-4757d4f8-194a-4336-a564-95b3db9c0cc9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091970 Jul 29 14:50:48.475253 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 623/1235] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:50:56.600877 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb08bae8-c11b-4b17-aa9a-d81d08cf8230", "device": "/dev/sdb"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:50:56.603846 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:50:56.606524 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=41 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:56.607178 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=90 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:50:56.612024 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:56.614770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:56.614770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:50:56.614770 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:50:57.342916 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-265535cb-e56b-4428-a186-71846ed4990f tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "POST /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745921 Jul 29 14:50:57.343520 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 613/1236] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:50:56 2022] POST /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:51:25.037904 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=49 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:25.042846 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:25.043428 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:25.050308 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:25.050760 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:25.051706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:25.051955 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:25.133782 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lazy-loading 'services' on Instance uuid 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:51:25.342297 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-326119cb-5ce7-4533-80f4-d6907706ccef tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0/os-volume_attachments/fb08bae8-c11b-4b17-aa9a-d81d08cf8230" status: 202 len: 0 microversion: 2.1 time: 0.305728 Jul 29 14:51:25.342828 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 624/1237] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:51:25 2022] DELETE /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0/os-volume_attachments/fb08bae8-c11b-4b17-aa9a-d81d08cf8230 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:51:26.467577 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:26.468893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:26.473115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:26.473702 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:26.480855 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:26.485362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:26.485362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:26.485362 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:26.509401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:51:26.836448 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-43ed4c72-ab72-45ad-8a60-6b12324911ae tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "DELETE /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 204 len: 0 microversion: 2.1 time: 0.369560 Jul 29 14:51:26.837212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 614/1238] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:51:26 2022] DELETE /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:51:26.846458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:26.847182 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:26.853466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:26.853970 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:26.854739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:26.855177 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:26.988118 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:26.995598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-bc98f7bd-c35e-4706-8f34-2591d5c82156 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1512 microversion: 2.1 time: 0.153966 Jul 29 14:51:26.996202 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 625/1239] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:26 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:28.017672 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:28.018405 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:28.025753 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:28.026203 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:28.026970 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:28.027406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:28.157655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:28.165563 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-e46d50df-4236-4465-9048-7e02b0a7a5b7 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1512 microversion: 2.1 time: 0.151890 Jul 29 14:51:28.166140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 615/1240] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:28 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:29.186177 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:29.186784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:29.193729 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:29.194171 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:29.194932 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:29.196009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:29.402178 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:29.409648 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2c10a771-84b2-4c5c-8137-a7697ba0f5f4 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1512 microversion: 2.1 time: 0.227288 Jul 29 14:51:29.410155 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 626/1241] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:29 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:29.805924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-2484c1d0-5dbb-4d7e-b466-50a9e6586fbb req-5b79f93c-e0af-4416-84ee-24cb9c87d920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3560fb1e-3c16-40a8-b9c1-cd4618deb5b0", "name": "network-vif-deleted", "tag": "470b5bfc-04bf-434d-a76c-ecfcafb56cdb"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:51:29.815697 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-2484c1d0-5dbb-4d7e-b466-50a9e6586fbb req-5b79f93c-e0af-4416-84ee-24cb9c87d920 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:29.817917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-2484c1d0-5dbb-4d7e-b466-50a9e6586fbb req-5b79f93c-e0af-4416-84ee-24cb9c87d920 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:29.829862 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-2484c1d0-5dbb-4d7e-b466-50a9e6586fbb req-5b79f93c-e0af-4416-84ee-24cb9c87d920 service nova] Creating event network-vif-deleted:470b5bfc-04bf-434d-a76c-ecfcafb56cdb for instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 on hv-cinder-79987 Jul 29 14:51:29.834954 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-2484c1d0-5dbb-4d7e-b466-50a9e6586fbb req-5b79f93c-e0af-4416-84ee-24cb9c87d920 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032669 Jul 29 14:51:29.835555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 616/1242] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:51:30.431310 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:30.432032 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:30.438493 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:30.438939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:30.439698 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:30.440132 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:30.471009 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:30.471451 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:30.471892 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lazy-loading 'fault' on Instance uuid 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:51:30.511891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:30.520205 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7c24cb22-8ec8-44bd-aee1-bbca1a780d90 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 200 len: 1308 microversion: 2.1 time: 0.093245 Jul 29 14:51:30.520776 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 627/1243] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:30 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:31.543236 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:31.543937 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:31.550454 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:31.550915 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:31.551662 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:31.552098 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:31.565643 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] HTTP exception thrown: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Request method failure captured: Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 HTTP/1.1 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_OlzLthrV_7lIrhtdG2hnK0LumpVglO5bk6eAdpP7vQftQxSUqVF3arVv6ik1QkHHV3Zck4-Ke34eVr_p4wWyKJyJQ2tZdb01u09pH7RiuMQzWfvuG5iRPzqbhV9PQNPBRADNRfxdZ6vUNFDd2gnr63CSfSyF9RQznpuhkPU_SxRck Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: dc6ddeb0546943f99c7e8610686183f5 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:51:31.567252 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc6ddeb0546943f99c7e8610686183f5"}]}] Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: dc6ddeb0546943f99c7e8610686183f5 Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesSnapshotTestJSON-859193283-project Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: bc265dfa04054c7ca16bdabed4146dd8 Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesSnapshotTestJSON-859193283-project Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. Jul 29 14:51:31.569060 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '3560fb1e-3c16-40a8-b9c1-cd4618deb5b0'} Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:51:31.570129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. Jul 29 14:51:31.572428 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:51:31.574177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Returning 404 to user: Instance 3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:51:31.574177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-c524ec91-fd77-48bf-b077-c391b002e5ab tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0" status: 404 len: 111 microversion: 2.1 time: 0.030260 Jul 29 14:51:31.574177 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 617/1244] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:31 2022] GET /compute/v2.1/servers/3560fb1e-3c16-40a8-b9c1-cd4618deb5b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:51:43.159218 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-121500599", "imageRef": "9a9988d5-1655-4ca3-a3e1-a437befc5551", "flavorRef": "452", "networks": [{"uuid": "84f2d907-752b-4efa-bdda-5e792b6ed1aa"}]}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:51:43.167921 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=11 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:43.168719 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:43.213312 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.network.neutron [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] validate_networks() for [('84f2d907-752b-4efa-bdda-5e792b6ed1aa', None, None, None, None, None)] {{(pid=124771) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 29 14:51:43.552323 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Flavor limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 29 14:51:43.552750 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Image limits 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 29 14:51:43.553251 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Flavor pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 29 14:51:43.553661 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Image pref 0:0:0 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 29 14:51:43.554072 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.virt.hardware [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124771) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 29 14:51:43.563070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:43.563515 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:43.564319 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:43.564774 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:43.581292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Getting quotas for project dc6ddeb0546943f99c7e8610686183f5. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 29 14:51:43.585108 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.quota [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Getting quotas for user bc265dfa04054c7ca16bdabed4146dd8 and project dc6ddeb0546943f99c7e8610686183f5. Resources: {'cores', 'ram', 'instances'} {{(pid=124771) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 29 14:51:43.596521 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Going to run 1 instances... {{(pid=124771) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Jul 29 14:51:43.598753 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9a9988d5-1655-4ca3-a3e1-a437befc5551',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124771) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Jul 29 14:51:43.708485 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-63630564-b8a6-4aca-a3e9-10fd49f923dd tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.553096 Jul 29 14:51:43.709174 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 628/1245] 10.222.0.49 () {60 vars in 1147 bytes} [Fri Jul 29 14:51:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 29 14:51:43.720633 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-ef82fc99-be8b-40c5-8ef3-b073febed117 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:43.721412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-ef82fc99-be8b-40c5-8ef3-b073febed117 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:43.724601 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:43.725351 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:43.777082 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-ef82fc99-be8b-40c5-8ef3-b073febed117 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:43.784168 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-ef82fc99-be8b-40c5-8ef3-b073febed117 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1218 microversion: 2.1 time: 0.067409 Jul 29 14:51:43.784733 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 618/1246] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:43 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:51:44.806079 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:44.806724 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:44.816217 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:44.819461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:44.819461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:44.819461 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:44.882504 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:44.890434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-9bbd25dc-070f-4f0f-9083-d44d73e1c292 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1222 microversion: 2.1 time: 0.088655 Jul 29 14:51:44.891189 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 629/1247] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:44 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:45.912665 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:45.913322 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:45.922023 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:45.925304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:45.925304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:45.925304 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:45.993782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:46.002990 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2aceb031-2a53-4d59-8af0-dfd7e0e20feb tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1288 microversion: 2.1 time: 0.095682 Jul 29 14:51:46.005677 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 619/1248] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:45 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:47.026042 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:47.027433 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:47.034086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:47.034541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:47.035324 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:47.035793 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:47.184562 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:47.191810 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-f49d5008-9787-445a-a7d4-fe3b22583c24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.170214 Jul 29 14:51:47.192366 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 630/1249] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:47 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:47.234658 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-3f9353c2-9a1d-4744-9d65-211739cb5cf5 req-5572f77c-4eb0-48d1-9a90-1646cce4a9b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10b60ca6-b616-4fab-90e9-5ba3899ca7cb", "tag": "f383fcaf-6bc3-411c-8f47-884b292d0dd1"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:51:47.246282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3f9353c2-9a1d-4744-9d65-211739cb5cf5 req-5572f77c-4eb0-48d1-9a90-1646cce4a9b8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:47.246883 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-3f9353c2-9a1d-4744-9d65-211739cb5cf5 req-5572f77c-4eb0-48d1-9a90-1646cce4a9b8 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:47.257951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-3f9353c2-9a1d-4744-9d65-211739cb5cf5 req-5572f77c-4eb0-48d1-9a90-1646cce4a9b8 service nova] Creating event network-changed:f383fcaf-6bc3-411c-8f47-884b292d0dd1 for instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb on hv-cinder-79987 Jul 29 14:51:47.263989 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-3f9353c2-9a1d-4744-9d65-211739cb5cf5 req-5572f77c-4eb0-48d1-9a90-1646cce4a9b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Jul 29 14:51:47.264587 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 620/1250] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:51:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 29 14:51:48.215660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:48.216309 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:48.222786 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:48.223252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:48.224032 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:48.224473 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:48.362818 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:48.370863 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-ec0c1cf3-5eb4-4433-947f-6d67f945d068 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.158769 Jul 29 14:51:48.371165 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 631/1251] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:48 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:49.392046 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:49.392751 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:49.399411 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:49.399866 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:49.400640 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:49.401111 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:49.529223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:49.536558 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f7f4a819-d6b3-479a-86d4-c7c262b97fd8 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.149213 Jul 29 14:51:49.537145 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 621/1252] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:49 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:50.558076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:50.558710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:50.565163 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:50.565611 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:50.566371 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:50.566804 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:50.692456 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:50.700445 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-287735c6-b5d1-4e12-be31-ba6494a81b34 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.146234 Jul 29 14:51:50.701025 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 632/1253] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:50 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:51.721307 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:51.721926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:51.728333 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:51.729241 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:51.729613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:51.730204 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:51.860853 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:51.868295 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-276acb8b-7950-4a17-a10a-aadf1d964ae5 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.150834 Jul 29 14:51:51.868869 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 622/1254] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:51 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:52.892370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:52.892983 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:52.899582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:52.900031 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:52.900802 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:52.901268 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:53.095658 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:53.099592 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3ee98019-6537-421e-8bde-60cfc32e06e6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.211069 Jul 29 14:51:53.100381 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 633/1255] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:52 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:53.946602 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-ff587505-ef4d-460b-8e83-1d8a3bd1d655 req-9a88e1ae-5cd7-4aef-ad94-c3245a413f1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b60ca6-b616-4fab-90e9-5ba3899ca7cb", "name": "network-vif-plugged", "status": "completed", "tag": "f383fcaf-6bc3-411c-8f47-884b292d0dd1"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:51:53.952847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell0:SELECT=2 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:53.958044 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ff587505-ef4d-460b-8e83-1d8a3bd1d655 req-9a88e1ae-5cd7-4aef-ad94-c3245a413f1b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:53.958492 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-ff587505-ef4d-460b-8e83-1d8a3bd1d655 req-9a88e1ae-5cd7-4aef-ad94-c3245a413f1b service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:53.970174 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-ff587505-ef4d-460b-8e83-1d8a3bd1d655 req-9a88e1ae-5cd7-4aef-ad94-c3245a413f1b service nova] Creating event network-vif-plugged:f383fcaf-6bc3-411c-8f47-884b292d0dd1 for instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb on hv-cinder-79987 Jul 29 14:51:53.975142 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-ff587505-ef4d-460b-8e83-1d8a3bd1d655 req-9a88e1ae-5cd7-4aef-ad94-c3245a413f1b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032152 Jul 29 14:51:53.975708 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 623/1256] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:51:54.120896 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:54.121560 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:54.123455 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:54.124112 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell0:SELECT=6 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:51:54.129428 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:54.129882 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:54.130639 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:54.131070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:54.266307 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:54.273789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-831d0bc4-fcba-4252-b72a-62e3def81ef3 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.157043 Jul 29 14:51:54.274351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 634/1257] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:54 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:55.297276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:55.297979 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:55.304610 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:55.305079 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:55.305847 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:55.306282 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:55.434034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:55.441386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0993f4f8-1e98-4153-895d-4bd5e7ce2a9c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1318 microversion: 2.1 time: 0.149783 Jul 29 14:51:55.441951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 624/1258] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:55 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:56.463131 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:51:56.463744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:56.470853 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:56.471305 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:56.472068 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:56.472513 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:56.602410 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:51:56.610771 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd488769-8664-4f6e-b51a-23486a17c10c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1506 microversion: 2.1 time: 0.151607 Jul 29 14:51:56.611361 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 635/1259] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:51:56 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:51:56.630759 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bd1c9dc-6e52-4fd1-b9fd-0a789d879978", "device": "/dev/sdb"}} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:51:56.633162 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:51:56.640180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:56.640624 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:56.641442 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:51:56.641875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:51:57.314472 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-69cfeb24-99a1-48f0-81cc-0c23fcdc481c tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "POST /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687418 Jul 29 14:51:57.315129 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 625/1260] 10.222.0.49 () {60 vars in 1323 bytes} [Fri Jul 29 14:51:56 2022] POST /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:52:21.518960 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:21.519487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:21.521476 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:52:21.522248 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=44 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:52:21.526762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:21.527215 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:21.527982 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:21.528421 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:21.608949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lazy-loading 'services' on Instance uuid 10b60ca6-b616-4fab-90e9-5ba3899ca7cb {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:52:21.794514 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-98cfaafb-37f5-4c73-9cb7-17d5bc9cb8f0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb/os-volume_attachments/1bd1c9dc-6e52-4fd1-b9fd-0a789d879978" status: 202 len: 0 microversion: 2.1 time: 0.279969 Jul 29 14:52:21.795102 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 636/1261] 10.222.0.49 () {58 vars in 1416 bytes} [Fri Jul 29 14:52:21 2022] DELETE /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb/os-volume_attachments/1bd1c9dc-6e52-4fd1-b9fd-0a789d879978 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:52:22.194095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:52:22.194302 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:52:23.970281 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:23.970867 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:23.973421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=18 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:52:23.974218 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:52:23.979127 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:23.979582 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:23.980360 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:23.980789 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:24.006149 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:52:24.309441 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-2742e8ce-dd7c-440c-9da4-ab2a90417224 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "DELETE /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 204 len: 0 microversion: 2.1 time: 0.343115 Jul 29 14:52:24.310052 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 626/1262] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:52:23 2022] DELETE /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:52:24.319254 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:24.319953 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:24.326285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:24.328487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:24.328487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:24.328487 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:24.456154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:52:24.463597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-cd50f94e-bae0-4d9e-bc98-b8b76188edf0 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1512 microversion: 2.1 time: 0.149022 Jul 29 14:52:24.464159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 637/1263] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:52:24 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:52:25.486292 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:25.486914 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:25.493421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:25.493875 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:25.494651 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:25.495093 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:25.621396 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:52:25.628933 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-16445ffd-5bd7-43e5-8237-187cd9a6c5f6 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1512 microversion: 2.1 time: 0.147008 Jul 29 14:52:25.629521 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 627/1264] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:52:25 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1512 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:52:26.650388 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:26.652022 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:26.659092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:26.659539 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:26.660360 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:26.660745 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:26.850903 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:52:26.858434 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-8e4519c4-816d-449f-83b2-8c7ce54d8c4e tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1512 microversion: 2.1 time: 0.211901 Jul 29 14:52:26.859002 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 638/1265] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:52:26 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1512 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:52:27.140561 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-a2cd487e-77ad-4a63-a09c-c9954badf0fb req-3622ef2f-8b14-47cb-b82c-47e76e531bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10b60ca6-b616-4fab-90e9-5ba3899ca7cb", "name": "network-vif-deleted", "tag": "f383fcaf-6bc3-411c-8f47-884b292d0dd1"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:52:27.151693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-a2cd487e-77ad-4a63-a09c-c9954badf0fb req-3622ef2f-8b14-47cb-b82c-47e76e531bf5 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:27.152144 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-a2cd487e-77ad-4a63-a09c-c9954badf0fb req-3622ef2f-8b14-47cb-b82c-47e76e531bf5 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:27.165817 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-a2cd487e-77ad-4a63-a09c-c9954badf0fb req-3622ef2f-8b14-47cb-b82c-47e76e531bf5 service nova] Creating event network-vif-deleted:f383fcaf-6bc3-411c-8f47-884b292d0dd1 for instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb on hv-cinder-79987 Jul 29 14:52:27.171334 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-a2cd487e-77ad-4a63-a09c-c9954badf0fb req-3622ef2f-8b14-47cb-b82c-47e76e531bf5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096437 Jul 29 14:52:27.171928 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 628/1266] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:52:27.880261 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:27.880905 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:27.887512 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:27.887961 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:27.888723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:27.889194 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:27.921128 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:27.921583 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:27.922033 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lazy-loading 'fault' on Instance uuid 10b60ca6-b616-4fab-90e9-5ba3899ca7cb {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:52:27.968566 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc265dfa04054c7ca16bdabed4146dd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc6ddeb0546943f99c7e8610686183f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:52:27.976920 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-39f6f1d2-ba6a-41a7-8c36-49c47605ab24 tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 200 len: 1308 microversion: 2.1 time: 0.100834 Jul 29 14:52:27.977454 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 639/1267] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:52:27 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:52:28.999035 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:52:28.999741 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] [instance: 10b60ca6-b616-4fab-90e9-5ba3899ca7cb] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:52:29.006297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:29.006754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:29.007540 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:52:29.007982 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:52:29.021386 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] HTTP exception thrown: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Request method failure captured: Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb HTTP/1.1 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_OlzLthrV_7lIrhtdG2hnK0LumpVglO5bk6eAdpP7vQftQxSUqVF3arVv6ik1QkHHV3Zck4-Ke34eVr_p4wWyKJyJQ2tZdb01u09pH7RiuMQzWfvuG5iRPzqbhV9PQNPBRADNRfxdZ6vUNFDd2gnr63CSfSyF9RQznpuhkPU_SxRck Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: dc6ddeb0546943f99c7e8610686183f5 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:52:29.023034 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dc6ddeb0546943f99c7e8610686183f5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dc6ddeb0546943f99c7e8610686183f5"}]}] Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: dc6ddeb0546943f99c7e8610686183f5 Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-859193283 Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-VolumesSnapshotTestJSON-859193283-project Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: bc265dfa04054c7ca16bdabed4146dd8 Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-VolumesSnapshotTestJSON-859193283-project Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. Jul 29 14:52:29.024842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '10b60ca6-b616-4fab-90e9-5ba3899ca7cb'} Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:52:29.025842 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. Jul 29 14:52:29.027447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:52:29.029133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] Returning 404 to user: Instance 10b60ca6-b616-4fab-90e9-5ba3899ca7cb could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:52:29.029133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-62f729d2-4b7d-4e09-a2d0-d95005bd75bc tempest-VolumesSnapshotTestJSON-859193283 tempest-VolumesSnapshotTestJSON-859193283-project] 10.222.0.49 "GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb" status: 404 len: 111 microversion: 2.1 time: 0.030186 Jul 29 14:52:29.029133 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 629/1268] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:52:28 2022] GET /compute/v2.1/servers/10b60ca6-b616-4fab-90e9-5ba3899ca7cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:52:34.922206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:52:34.922865 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:52:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:53:33.407599 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=10 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:53:33.408289 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:53:33.412321 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:53:33.412849 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:33.418999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:33.423706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:33.423706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:33.423706 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:33.442667 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lazy-loading 'flavor' on Instance uuid 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:53:33.733256 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3cf75842-f2ce-4ea2-b9bf-2d99c0712afa tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "POST /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3/action" status: 202 len: 0 microversion: 2.1 time: 0.326968 Jul 29 14:53:33.733761 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 640/1269] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:53:33 2022] POST /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:53:33.739901 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:53:33.740656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:53:33.744650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:33.745811 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:33.751781 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:33.752228 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:33.753031 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:33.753466 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:33.889813 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:33.897454 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f42501e9-6f35-44d8-8c36-62f70fb3a73b tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.159222 Jul 29 14:53:33.898028 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 630/1270] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:33 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:34.920471 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:34.921187 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:34.928604 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:34.929084 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:34.930687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:34.931126 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:35.064590 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:35.072089 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e6cabd4b-94a3-4797-92e7-76d46deca952 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.157178 Jul 29 14:53:35.072644 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 641/1271] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:34 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:36.094526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:36.095219 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:36.102417 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:36.102859 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:36.103618 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:36.104048 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:36.236956 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:36.244374 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-b7789a86-22b7-428d-98b2-7a9ce7780540 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.153731 Jul 29 14:53:36.244925 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 631/1272] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:36 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:37.265552 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:37.266191 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:37.272717 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:37.273216 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:37.273996 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:37.274438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:37.406082 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:37.413598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-56c752d0-ac9b-40c7-a3ee-6d91cfbaab60 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.151971 Jul 29 14:53:37.414157 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 642/1273] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:37 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:38.436490 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:38.437055 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:38.443491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:38.443942 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:38.444714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:38.445180 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:38.576342 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:38.583826 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-4766882a-bbcd-4873-8422-20be70541553 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.152091 Jul 29 14:53:38.584385 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 632/1274] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:38 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:39.604800 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:39.606397 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:39.612864 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:39.613346 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:39.614103 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:39.614535 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:39.746505 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:39.754408 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-53d27918-bec1-4819-96e7-72748ae4fa74 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.153505 Jul 29 14:53:39.754972 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 643/1275] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:39 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:40.775659 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:40.776276 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:40.783036 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:40.783488 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:40.784249 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:40.784683 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:40.912894 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:40.921370 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-157eacc5-1a97-49fc-a205-5595ff2615ea tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.149581 Jul 29 14:53:40.921932 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 633/1276] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:40 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:41.942490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:41.943111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:41.949967 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:41.950420 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:41.951193 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:41.951634 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:42.079895 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:42.087519 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-1d5af9f0-7a2e-4e04-aa9d-c65a9047074a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.148911 Jul 29 14:53:42.088086 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 644/1277] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:41 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:43.108510 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:43.109198 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:43.115140 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:43.115578 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:43.116330 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:43.116762 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:43.249603 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:43.257195 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-07207be8-7c71-43bb-addf-588a2893e02a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.152736 Jul 29 14:53:43.257764 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 634/1278] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:43 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:44.280070 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:44.280796 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:44.287406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:44.287799 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:44.288568 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:44.289017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:44.500598 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:44.508159 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-31e48424-5875-4ec2-810d-92857fb24b5a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.232759 Jul 29 14:53:44.508744 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 645/1279] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:44 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:45.530543 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:45.531151 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:45.537713 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:45.538156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:45.538907 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:45.539361 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:45.670106 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:45.677574 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-42c8c5da-669b-456f-9987-a26f823444ca tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.151422 Jul 29 14:53:45.678137 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 635/1280] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:45 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:46.699188 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:46.699795 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:46.706208 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:46.708689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:46.708689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:46.708689 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:46.838649 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:46.849914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a5cca12d-3051-402e-8eac-eda936c79b94 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.151956 Jul 29 14:53:46.849914 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 646/1281] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:46 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:47.867612 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:47.868214 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:47.875650 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:47.876088 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:47.876841 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:47.877297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.006104 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:48.013734 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-66911285-a526-4573-9c78-e43dc93868d4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1507 microversion: 2.1 time: 0.149991 Jul 29 14:53:48.014297 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 636/1282] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:47 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1507 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:48.033949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:53:48.034576 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:48.041285 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:48.041736 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.043050 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:48.043580 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.083220 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=124771) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Jul 29 14:53:48.309018 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-780f113d-301b-4e3c-b36f-d130203bce92 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "POST /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3/action" status: 202 len: 0 microversion: 2.1 time: 0.278787 Jul 29 14:53:48.309949 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 647/1283] 10.222.0.49 () {60 vars in 1278 bytes} [Fri Jul 29 14:53:48 2022] POST /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:53:48.317673 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:48.318300 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:48.324926 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:48.325401 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.326185 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:48.326628 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.354368 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c25cef61-0d78-4fa7-bd35-8327c0c3c30b req-9c99e89f-55bf-42c0-94b8-e131517c395a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "name": "network-vif-unplugged", "status": "completed", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:53:48.364011 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c25cef61-0d78-4fa7-bd35-8327c0c3c30b req-9c99e89f-55bf-42c0-94b8-e131517c395a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:48.364458 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c25cef61-0d78-4fa7-bd35-8327c0c3c30b req-9c99e89f-55bf-42c0-94b8-e131517c395a service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:48.376358 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.compute.server_external_events [req-c25cef61-0d78-4fa7-bd35-8327c0c3c30b req-9c99e89f-55bf-42c0-94b8-e131517c395a service nova] Unable to find a host for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3. Dropping event network-vif-unplugged {{(pid=124771) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 29 14:53:48.377276 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c25cef61-0d78-4fa7-bd35-8327c0c3c30b req-9c99e89f-55bf-42c0-94b8-e131517c395a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026765 Jul 29 14:53:48.378049 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 648/1284] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 29 14:53:48.477429 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:48.487426 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-0abfd755-b823-47b6-bfbf-14a5b84d1605 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1515 microversion: 2.1 time: 0.173484 Jul 29 14:53:48.488358 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 637/1285] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:48 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1515 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:49.513153 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:49.513772 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:49.520336 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:49.520784 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:49.521582 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:49.522023 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:49.659154 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:49.666757 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e1c2ac08-6618-4565-a8b6-ee60ef60616d tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1517 microversion: 2.1 time: 0.158301 Jul 29 14:53:49.667386 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 649/1286] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:49 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:50.688858 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:50.689545 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:50.695893 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:50.696335 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:50.697124 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:50.697555 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:50.830622 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:50.838404 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-257053a5-6d3c-4da1-a4aa-0638182185e2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1517 microversion: 2.1 time: 0.153400 Jul 29 14:53:50.838977 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 638/1287] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:50 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 29 14:53:51.859606 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:51.860221 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:51.866755 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:51.867207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:51.868074 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:51.868511 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:52.049292 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:52.056891 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-63293cde-e46e-4cfe-bde4-40160e282182 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.201160 Jul 29 14:53:52.057490 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 650/1288] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:51 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:53.079681 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:53.080312 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:53.086743 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:53.087182 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:53.087948 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:53.088387 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:53.223390 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:53.230836 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f3e2a7ab-1030-411e-880d-26c95c585af4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.155632 Jul 29 14:53:53.232108 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 639/1289] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:53 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:54.251751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:54.252363 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:54.258809 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:54.259257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:54.260020 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:54.260453 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:54.393968 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:54.401466 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7f59aa23-5ae8-444a-9f95-8f73985214ac tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.153484 Jul 29 14:53:54.402030 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 651/1290] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:54 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:55.423585 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:55.424115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:55.430495 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:55.430934 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:55.431691 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:55.432123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:55.560269 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:55.567514 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-6418a963-ce41-4a33-8622-6eb5b17d9ad8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.148824 Jul 29 14:53:55.568083 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 640/1291] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:55 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:56.589274 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:56.589907 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:56.596924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:56.597746 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:56.598224 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:56.598668 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:56.727111 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:56.735370 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-7ee4946e-5a43-48b5-b096-4e6c05d15061 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.149965 Jul 29 14:53:56.735939 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 652/1292] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:56 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:57.755715 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:57.756330 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:57.762922 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:57.763372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:57.764138 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:57.764573 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:57.896194 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:57.903693 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-44d16c78-2a78-4fd2-ab19-0fb8dbc0f7a8 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.151795 Jul 29 14:53:57.904257 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 641/1293] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:57 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:53:58.925382 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:53:58.925987 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:53:58.932425 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:58.932873 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:58.933659 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:53:58.934092 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:53:59.066127 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:53:59.073902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-d4d77a33-ecb1-4b7a-953b-76d059d3d13c tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.152337 Jul 29 14:53:59.074477 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 653/1294] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:53:58 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:00.096206 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:00.096816 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:00.103336 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:00.103779 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:00.104536 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:00.105013 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:00.235547 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:00.242951 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-185219ed-3bc1-44ee-a717-0a48f44363a5 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.151910 Jul 29 14:54:00.243516 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 642/1295] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:00 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:01.263789 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:01.264398 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:01.271653 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:01.272107 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:01.273017 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:01.273376 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:01.282259 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:54:01.400447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:01.408060 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-5d4c61d6-b235-4fc0-8e43-0600f61565e0 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.148168 Jul 29 14:54:01.408553 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 654/1296] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:01 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:02.429834 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:02.430447 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:02.437738 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:02.438190 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:02.438964 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:02.439402 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:02.569754 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:02.577797 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f6b06045-336e-4794-9af2-5ab186e375b1 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.151750 Jul 29 14:54:02.578372 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 643/1297] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:02 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:03.599040 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:03.599654 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:03.601950 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:54:03.606660 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:03.607156 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:03.607952 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:03.608385 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:03.740252 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:03.748383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-2c716621-163e-46a3-a223-134889d0d072 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.153172 Jul 29 14:54:03.748924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 655/1298] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:03 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:04.420268 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [req-575a73e8-225a-486c-9127-74acfc01c3bd req-cc55d215-4de9-4139-a9ed-93093ec9eb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "name": "network-vif-plugged", "status": "completed", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:54:04.425562 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=29 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:54:04.430659 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-575a73e8-225a-486c-9127-74acfc01c3bd req-cc55d215-4de9-4139-a9ed-93093ec9eb76 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:04.431109 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [req-575a73e8-225a-486c-9127-74acfc01c3bd req-cc55d215-4de9-4139-a9ed-93093ec9eb76 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:04.442958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.compute.server_external_events [req-575a73e8-225a-486c-9127-74acfc01c3bd req-cc55d215-4de9-4139-a9ed-93093ec9eb76 service nova] Creating event network-vif-plugged:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:54:04.448097 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [req-575a73e8-225a-486c-9127-74acfc01c3bd req-cc55d215-4de9-4139-a9ed-93093ec9eb76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032304 Jul 29 14:54:04.448703 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 644/1299] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:54:04.769769 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:04.770383 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:04.777095 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:04.777542 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:04.778339 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:04.778890 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:04.909924 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:04.917326 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-e436826b-f089-4f92-81cc-85278b2ac6c4 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.151496 Jul 29 14:54:04.917888 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 656/1300] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:04 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:05.940227 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:05.940924 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:05.947958 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:05.948406 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:05.949212 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:05.949655 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:06.087491 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:06.094992 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-f0f5e48d-9713-4826-a666-ff7e0bc33b51 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1573 microversion: 2.1 time: 0.158993 Jul 29 14:54:06.095642 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 645/1301] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:05 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1573 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:54:07.117294 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:54:07.117906 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:54:07.124439 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:07.124889 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:07.125694 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:54:07.126129 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:54:07.258076 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:54:07.265594 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-0dd7215d-e5d3-45db-8803-027c9a3d5ea6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1560 microversion: 2.1 time: 0.152129 Jul 29 14:54:07.266142 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 657/1302] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:54:07 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:55:42.201976 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:55:42.202597 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:55:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:55:46.592656 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:55:46.593223 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:55:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:55:51.948064 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f6c642d-c267-4030-8813-a29fb47cf030] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 14:55:51.949271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:51.949271 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:51.951570 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR oslo.messaging._drivers.impl_rabbit [-] [715526b3-092e-4302-a0fa-fdb49621fce8] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 29 14:55:51.952094 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_api:SELECT=3 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:55:51.952228 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-c29eec35-9920-4df2-b551-a572c05fa7c7 req-2a8146d9-a7cf-4812-860f-d58135d60e19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:55:51.952971 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG dbcounter [-] [124772] Writing DB stats nova_cell1:SELECT=92 {{(pid=124772) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:55:51.958171 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:51.958748 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_api:SELECT=5 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:55:51.959067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:51.959413 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG dbcounter [-] [124771] Writing DB stats nova_cell1:SELECT=22 {{(pid=124771) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 29 14:55:51.960105 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:51.960760 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:51.963732 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c29eec35-9920-4df2-b551-a572c05fa7c7 req-2a8146d9-a7cf-4812-860f-d58135d60e19 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:51.964186 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-c29eec35-9920-4df2-b551-a572c05fa7c7 req-2a8146d9-a7cf-4812-860f-d58135d60e19 service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:51.979255 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-c29eec35-9920-4df2-b551-a572c05fa7c7 req-2a8146d9-a7cf-4812-860f-d58135d60e19 service nova] Creating event network-changed:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:55:51.985447 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-c29eec35-9920-4df2-b551-a572c05fa7c7 req-2a8146d9-a7cf-4812-860f-d58135d60e19 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039041 Jul 29 14:55:51.986207 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 658/1303] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:55:51.993742 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Going to try to terminate instance {{(pid=124772) delete /opt/stack/nova/nova/compute/api.py:2666}} Jul 29 14:55:52.249504 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-94df66bc-42c9-4b34-8f6d-7daad6a5634f tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "DELETE /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 204 len: 0 microversion: 2.1 time: 0.306168 Jul 29 14:55:52.250455 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 646/1304] 10.222.0.49 () {58 vars in 1239 bytes} [Fri Jul 29 14:55:51 2022] DELETE /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 29 14:55:52.260351 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:52.263019 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:52.267999 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:52.268687 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:52.269752 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:52.270257 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:52.480710 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:55:52.488739 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-3d13bc0c-7d76-40a0-970b-cd8c8207e377 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.233897 Jul 29 14:55:52.489317 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 659/1305] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:55:52 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:55:53.511808 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:53.512535 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:53.520115 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:53.520560 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:53.521356 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:53.521792 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:53.541407 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] [715526b3-092e-4302-a0fa-fdb49621fce8] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 54252. Jul 29 14:55:53.727412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:55:53.734984 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-501e8796-c11a-4ab5-9833-e7ad1b914af2 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1566 microversion: 2.1 time: 0.227510 Jul 29 14:55:53.735548 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 647/1306] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:55:53 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1566 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:55:54.670869 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [req-615c1cce-5770-4f00-bb6f-3813a5c28270 req-aafdfc38-2d06-44b0-83db-095957e8e71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34375bd1-90a7-4b6c-bb6a-6d177a23d9c3", "name": "network-vif-deleted", "tag": "f01f32ed-6233-4de7-b21f-270345b80688"}]} {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 29 14:55:54.687894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-615c1cce-5770-4f00-bb6f-3813a5c28270 req-aafdfc38-2d06-44b0-83db-095957e8e71e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:54.687894 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [req-615c1cce-5770-4f00-bb6f-3813a5c28270 req-aafdfc38-2d06-44b0-83db-095957e8e71e service nova] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:54.695124 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.compute.server_external_events [req-615c1cce-5770-4f00-bb6f-3813a5c28270 req-aafdfc38-2d06-44b0-83db-095957e8e71e service nova] Creating event network-vif-deleted:f01f32ed-6233-4de7-b21f-270345b80688 for instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 on hv-cinder-79987 Jul 29 14:55:54.698626 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f6c642d-c267-4030-8813-a29fb47cf030] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 54262. Jul 29 14:55:54.700247 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [req-615c1cce-5770-4f00-bb6f-3813a5c28270 req-aafdfc38-2d06-44b0-83db-095957e8e71e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Jul 29 14:55:54.700830 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 660/1307] 10.222.0.49 () {64 vars in 1317 bytes} [Fri Jul 29 14:55:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 29 14:55:54.756469 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:54.757285 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:54.763714 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:54.764156 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:54.764917 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:54.765384 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:54.830392 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.policy [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124772) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:55:54.838421 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-94f9cef0-b77d-4870-9e4a-8ee16e7102fb tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1380 microversion: 2.1 time: 0.086324 Jul 29 14:55:54.838981 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 648/1308] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:55:54 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1380 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:55:54.931355 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:55:54.931526 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:55:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:55:55.860430 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:55.861161 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.compute.api [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124771) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:55.867845 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:55.868296 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:55.869128 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:55.869541 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:55.899460 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:55.899957 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG oslo_concurrency.lockutils [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124771) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:55.900362 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.objects.instance [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lazy-loading 'fault' on Instance uuid 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 {{(pid=124771) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 29 14:55:55.943723 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.policy [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24992429cbbd47f3958e0de1be93916a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be1df25ae6404f33b88dda96469e9a7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124771) authorize /opt/stack/nova/nova/policy.py:199}} Jul 29 14:55:55.951335 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-a56c301c-6378-49a1-8fda-f3882f5b80f6 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 200 len: 1223 microversion: 2.1 time: 0.095061 Jul 29 14:55:55.951902 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 661/1309] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:55:55 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 29 14:55:56.972354 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '>' {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:56.973022 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.compute.api [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] [instance: 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3] Fetching instance by UUID {{(pid=124772) get /opt/stack/nova/nova/compute/api.py:2922}} Jul 29 14:55:56.979613 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:56.980067 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:56.980836 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 29 14:55:56.981306 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG oslo_concurrency.lockutils [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Lock "cbe46424-675f-40f2-a0b6-2e5b8f5e805f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124772) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 29 14:55:56.994123 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.wsgi [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] HTTP exception thrown: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Request method failure captured: Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: request: GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 HTTP/1.1 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept: application/json Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Accept-Encoding: identity Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Connection: close Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Length: 0 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Content-Type: application/json Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Host: 10.222.0.49 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Openstack-System-Scope: None Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: User-Agent: python-urllib3/1.26.10 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Auth-Token: gAAAAABi4_ORF_dbIj2R9WjNOc-F2LXT5u0xWPq3MeEkyIbFinWSKFx0TDmEeRwbrW0C9MyYVqU9dLTldVObzDBAXAFzzZVwbHopH-Ob9ayqU0fCymy1K1DvcaGFOap4c35Am6x0-9Ygyaq3gYW0QlUjZ3_I874LXZu7-fxTzQr8zL0DLeuYqi4 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Id: None Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Domain-Name: None Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Identity-Status: Confirmed Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Is-Admin-Project: True Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Id: default Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Domain-Name: Default Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Id: be1df25ae6404f33b88dda96469e9a7e Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Project-Name: tempest-TestShelveInstance-1416764248 Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Role: member,reader Jul 29 14:55:56.995735 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Roles: member,reader Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_be1df25ae6404f33b88dda96469e9a7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/be1df25ae6404f33b88dda96469e9a7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/be1df25ae6404f33b88dda96469e9a7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/be1df25ae6404f33b88dda96469e9a7e"}]}] Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant: tempest-TestShelveInstance-1416764248 Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Id: be1df25ae6404f33b88dda96469e9a7e Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-Tenant-Name: tempest-TestShelveInstance-1416764248 Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User: tempest-TestShelveInstance-1416764248-project Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Id: default Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Domain-Name: Default Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Id: 24992429cbbd47f3958e0de1be93916a Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: X-User-Name: tempest-TestShelveInstance-1416764248-project Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: method: > Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: exception: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. Jul 29 14:55:56.997412 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: action_args: {'id': '34375bd1-90a7-4b6c-bb6a-6d177a23d9c3'} Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: {{(pid=124772) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 29 14:55:56.998403 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. Jul 29 14:55:57.000058 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: ERROR nova.api.openstack.wsgi Jul 29 14:55:57.001782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: DEBUG nova.api.openstack.wsgi [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Returning 404 to user: Instance 34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 could not be found. {{(pid=124772) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 29 14:55:57.001782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO nova.api.openstack.requestlog [None req-cb7ea41e-1d5d-4f8f-999a-14082d572a1a tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3" status: 404 len: 111 microversion: 2.1 time: 0.028683 Jul 29 14:55:57.001782 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: [pid: 124772|app: 0|req: 649/1310] 10.222.0.49 () {58 vars in 1236 bytes} [Fri Jul 29 14:55:56 2022] GET /compute/v2.1/servers/34375bd1-90a7-4b6c-bb6a-6d177a23d9c3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 29 14:55:57.244438 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: DEBUG nova.api.openstack.wsgi [None req-37930786-a4d4-4c51-bc02-290bb6b9e944 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] Calling method '.version_select at 0x7f6803e57ca0>' {{(pid=124771) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 29 14:55:57.320751 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO nova.api.openstack.requestlog [None req-37930786-a4d4-4c51-bc02-290bb6b9e944 tempest-TestShelveInstance-1416764248 tempest-TestShelveInstance-1416764248-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285597735" status: 202 len: 0 microversion: 2.1 time: 0.080483 Jul 29 14:55:57.321406 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: [pid: 124771|app: 0|req: 662/1311] 10.222.0.49 () {58 vars in 1251 bytes} [Fri Jul 29 14:55:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-285597735 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 29 14:59:02.210829 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:59:02.211423 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:59:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:59:06.602110 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:59:06.602739 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:59:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:59:11.017762 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:59:11.018369 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 14:59:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 14:59:14.939689 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 14:59:14.940170 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 14:59:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 15:01:12.829633 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 15:01:12.830140 dv-cinder-799871-49-iscsi devstack@n-api.service[124771]: Fri Jul 29 15:01:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 29 15:01:15.042776 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 29 15:01:15.043288 dv-cinder-799871-49-iscsi devstack@n-api.service[124772]: Fri Jul 29 15:01:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!